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NOTICE 


This  is  an  unclassified  version  of  the  FY  1588  Annual  Report  of  the  Director,  Opera¬ 
tional  Test  and  Evaluation.  The  original,  classified  version  of  this  report  was  submitted  to 
the  Secretary  of  Defense  and  the  House  and  Senate  Committees  on  Armed  Services  and 
on  Appropriations  on  19  January  1989  pursuant  to  the  provisions  of  Section  138,  Title  10, 
U.S.  Code.J) 

~  This  unclassified  version  has  been  published  in  order  to  promote  wider  understanding 
of  the  role  of  operational  testing  in  the  development  and  acquisition  of  effective  and 
affordable  weapon  systems,  j_ ;  A,M~  ,  >/  U 
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FY88  DOT&E  ANNUAL  REPORT  TO  CONGRESS 


The  Office  of  the  Director,  Operational  Test  and  Evaluation  authored, 
compiled,  and  published  this  report  to  provide  you  with  useful  information  on  the 
current  status  of  major  programs  and  the  initiatives  that  DOT&E  pursued  in  FY 
1988.  Have  we  given  you  what  you  want?  Please  fill  out  your  response  to  the 
questions  below  so  that  next  year’s  edition  can  be  improved  and  enhanced  to 
better  meet  your  needs.  After  filling  out  this  questionnaire,  fold,  staple,  and 
forward  to  the  address  on  the  back  of  this  sheet.  Your  responses  are  appreciated. 
Thank  You! 


Was  this  report  organized  in  an  easy-to-use  format?  _ yes  _ no 

Were  the  subjects  adequately  covered?  _ yes  _ no 

What  changes  would  you  make  to  the  content  of  this  report? 


What  changes  would  you  make  to  the  format  of  this  report? 


Have  we  told  you  what  you  want  to  know? 


What  did  you  like  most  about  this  report? 


What  did  you  like  least  about  this  report? 


Please  provide  additional  comments  on  a  separate  sheet  of  paper. 
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DIRECTOR’S  INTRODUCTION 


As  Benjamin  Franklin  so  wisely  observed, 
an  ounce  of  prevention  is  worth  a  pound 
of  cure.  As  I  see  it,  this  means  always 
striving  to  do  the  right  thing,  the  right 
way,  the  first  time,  and  every  time. 


This  is  the  kind  of  thinking  that  under¬ 
lies  the  Department  of  Defense’s  (DoD) 
commitment  to  “Total  Quality  Manage¬ 
ment”  (TQM).  It  is  also  the  basis  for  key 
policy,  resource,  and  organizational  initia¬ 
tives  conceived  and  championed  by  this 
office  since  1985.  Some  have  now  been  in 
>lace  for  quite  a  while.  Others  have  been 
aunched  or  have  come  to  fruition  during 
^88  and  are  discussed  in  some  detail  in 
this  report. 

All  of  our  initiatives  are  aimed  at  con¬ 
tinuous  improvement  of  the  defense  acqui¬ 
sition  process  through  early,  on-going, 
and  ever-better  operationally  focused  test 
and  evaluation  (T&E),  and  ever-better  in¬ 
dependent  and  timely  reporting  of  T&E  re¬ 
sults  and  assessments  to  decision  makers. 


The  measure  of  our  success  is  “cus¬ 
tomer”  satisfaction:  Did  the  men  and 
women  in  the  field  get  what  they  wanted 
and  needed  when  they  wanted  and  needed 
it?  Does  it  do  the  job  the  users  want  it  to 
do?  Do  the  users  consider  it  reliable  and 
maintainable. 


In  mandating  the  establishment  of  this 
office,  Congress  recognized  that  an  opera¬ 
tional  T&E  oversight  official,  independent 
of  the  development  and  acquisition  com¬ 
munity  and  with  direct  access  to  top  DoD 
and  congressional  decision  makers,  is  es¬ 
sential  to  improved  customer  satisfaction. 
I  have  interpreted  the  congressional  man¬ 
date  to  mean  just  that— improved  customer 
satisfaction:  weapon  systems  and  equip¬ 
ment  that  work  as  the  users  want  them  to 


work,  fielded  when  the  users  want  them 
fielded. 

This  has  required  an  activist  approach, 
involving  the  development  of  policies  and 
techniques  to  permit  the  operational  T&E 
community  to  (1)  have  early,  independent, 
and  continuous  insight  into  the  progress  of 
programs;  (2)  have  the  means  of  inde¬ 
pendently  reporting  its  findings  to  decision 
makers  on  a  continuous,  life-of-the-pro- 
gram  basis;  and  (3)  have  the  resources  it 
needs  to  gather  meaningful  information 
from  which  derive  its  evaluations  and  as¬ 
sessments. 

We  have  had  significant  success  in  all 
these  areas,  and  there  is  great  promise  for 
continuous  improvement  on  all  fronts. 
Working  with  the  Service  operational  test 
agencies  (OTAs),  we  have  developed  such 
assessment  and  reporting  tools  as  the 
Early  Operational  Assessment  and  the 
System  Maturity  Matrix.  These  and  other 
devices  and  assessment  processes  permit 
independent,  objective  operationally  ori¬ 
ented  evaluation  of  system  progress  at 
every  stage  in  the  life  of  a  program. 

In  turn,  this  provides  the  substance  for 
reports  to  decision  makers  at  all  major  de¬ 
cision  milestones  and  on  a  continuous, 
“status  report”  basis.  For  milestone  deci¬ 
sions,  the  forum  is  the  Defense  Acquisi¬ 
tion  Board  (of  which  I  am  a  permanent 
member)  or  the  Service-level  equivalent. 
When  a  decision  is  to  be  reached  on  enter¬ 
ing  full-rate  production,  I  submit  a  de¬ 
tailed  report  (the  “B-LRIP”  report)  on  the 
adequacy  of  operational  effectiveness  and 
suitability  of  the  system  or  system  compo¬ 
nents  tested.  By  law,  these  reports  go  to 
the  Secretary,  the  Under  Secretary  for  Ac¬ 
quisition,  and  the  defense  committees  of 
Congress.  We  also  provide  copies  to  a 
substantial  number  of  interested  DoD, 
Service,  and  congressional  officials.  (All 
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unclassified  B-LRIP  reports  issued  during 
FY88  and  the  first  quarter  of  FY89  are  re¬ 
produced  in  Part  VII  of  this  report.) 

Status  reports  are  provided  in  a  variety 
of  ways,  including  our  monthly  opera¬ 
tional  T&E  highlights  letters  to  the  Secre¬ 
tary  and  interested  congressional  staff  and 
others;  our  Annual  Report,  such  as  you 
now  hold  in  your  hand;  and  a  new  mecha¬ 
nism,  the  Defense  Acquisition  Executive 
Summary  (DAES),  initiated  by  the  Under 
Secretary  for  Acquisition.  The  DAES, 
presented  to  the  Under  Secretary  at  a 
monthly  meeting,  provides  a  snapshot  look 
at  the  progress  of  a  program.  Each  major 
defense  acquisition  program  is  covered  in 
a  DAES  on  a  quarterly  basis.  Our  office 
contributes  an  independent  assessment  of 
system  progress  toward  operational  effec¬ 
tiveness  and  suitability  based  on  test  re¬ 
sults  to  date  and  other  pertinent  informa¬ 
tion. 

We  are  striving  constantly  to  improve 
the  value  of  our  reports  to  those  who  use 
them.  We  have  developed  sets  of  guide¬ 
lines  for  assessment  and  evaluation  of  test 
results  and  for  preparation  of  B-LRIP  re¬ 
ports.  This  year,  we  have  significantly  re¬ 
vised  the  format  of  our  Annual  Report  to 
make  it  more  convenient  to  use  and,  as 
noted  above,  for  the  first  time  included  all 
B-LRIP  reports  for  the  year,  a  feature  that 
will  be  continued  in  future  Annual  Re¬ 
ports. 

We  have  made  what  is  perhaps  our 
most  significant  progress  in  the  T&E  re¬ 
sources  area.  The  President’s  Budget  for 
FY90  includes— for  the  first  time— a  con¬ 
solidated,  DoD-level  funding  line  for  test 
resources  to  build  up  a  significantly  ex¬ 
panded  and  up-to-date  National  Test 
Capability  Base.  The  program  calls  for 
investment  of  more  than  $1.3  billion  in  fis¬ 
cal  years  1990-94  and  will  be  managed  by 
the  Test  and  Evaluation  Committee,  estab¬ 
lished  in  FY87  to  oversee  T&E  resource 
and  policy  matters  on  a  DoD-wide  basis. 


This  program  is  a  dramatic  and  very  im- 

1>ortant  step  toward  assuring  that,  over  the 
ong  term,  we  will  have  the  test-resources 
planning,  management,  and  investment 
necessary  to  evaluate  properly  the  highly 
sophisticated  systems  now  under  develop¬ 
ment. 

To  cope  with  critical  short-term  gaps 
in  test  resources,  we  have  implemented 
our  Operational  Test  and  Evaluation  Ca¬ 
pability  Improvement  Program  (OT&E 
CIP).  Begun  in  FY88,  the  OT&E  CIP  has 
given  us  the  ability  to  quickly  and  very 
cost  effectively  acquire  urgently  needed 
test  resources,  including  actual  threat  sys¬ 
tems. 

Organizationally,  we  have  grown  sig¬ 
nificantly.  We  now  have  a  staff  of  52,  and 
we  have  recently  established  a  deputy  di¬ 
rectorate  for  strategic  systems.  This  dep¬ 
uty  is  responsible  for  oversight  of  T&E 
matters  for  all  programs  under  the  cogni¬ 
zance  of  the  Defense  Acquisition  Board 
Strategic  Systems  Committee  (e.g.,  B-2, 
MX  Rail  Garrison,  SDS,  and  ACM). 

We  have  also  added  a  science  advisor, 
a  reliability  and  maintainability  (RAM) 
specialist,  and  an  information  systems 
specialist.  These  highly  experienced  and 
expert  professionals  assist  our  program 
oversight  staff  in  the  evaluation  of  test 
plans  and  results,  provide  expert  advice  to 
me  personally,  and  aid  in  the  development 
of  T&E  policy.  In  addition,  the  science 
advisor  and  our  staff  assistant  for  T&E 
policy  and  compliance  are  working  closely 
with  the  Service  operational  test  agencies 
and  the  Defense  Systems  Management 
College  to  significantly  improve  the  T&E 
education  of  program  managers  and  other 
acquisition  and  T&E  officials. 

There  is  still  some  important  unfin¬ 
ished  business  on  the  organizational  front. 
Although  establishment  of  the  Test  and 
Evaluation  Committee  and  close  coopera¬ 
tion  between  our  office  and  that  of  the 
Deputy  Director,  Defense  Research  and 
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Engineering  (Test  and  Evaluation)  have 
done  much  to  improve  the  effectiveness  of 
OSD-level  T&E  oversight,  there  is  still  a 
critical  need  to  implement  the  organiza¬ 
tional  realignment  called  for  in  the  Report 
of  the  Secretary  of  Defense  on  Test  and 
Evaluation  in  the  Department  of  Defense 
(September  1987).  The  Department 
awaits  congressional  action  on  this  ques¬ 
tion,  and  it  is  my  sincere  hope  that  it  will 
be  resolved  early  in  the  first  session  of  the 
101st  Congress. 

Not  all  agree  with  the  approach  we  are 
following  in  carrying  out  the  mandate  of 
Congress.  It  has  engendered  not  a  little 
controversy.  Of  course,  there  is  always 
room  for  improvement--“good  enough”  is 
not  good  enough.  I  welcome  the  sugges¬ 
tions  and  assistance  of  all  who  share  our 
commitment  to  continuous  improvement 
of  the  process  to  achieve  ever-greater  cus¬ 


tomer  satisfaction  by  acquiring  weapon 
systems  that  work  as  the  users  want  them 
to,  and  fielding  them  when  the  users  want 
them  fielded.  One  thing  you  can  do  right 
now  is  let  us  know  how  we  are  doing  with 
our  Annual  Report.  There  is  a  pre-ad- 
dressed,  brief  questionnaire  bound  into 
the  front  of  this  volume.  Please  take  a 
minute  to  fill  it  out  and  return  it  to  us. 
Thank  you. 
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ACTIVITY  SUMMARY 


During  this  fiscal  year,  DOT&E  activity 
has  involved  oversight  of  197  programs, 
including  21  under  the  purview  of  the  Ma¬ 
jor  Automated  Information  System  Review 
Council  (MAISRC)  and  four  NATO  com¬ 
parative  test  programs.  Our  oversight  ac¬ 
tivity  commences  with  the  early 


acquisition  milestones,  continues  through 
approval  for  full-rate  production  and,  in 
some  instances,  during  full  production  un¬ 
til  deleted  from  the  DOT&E  oversight  list. 
During  FY88,  our  review  of  test  planning 
activities  included  Test  and  Evaluation 
Master  Plans  (TEMPS)  for  43  programs 


TEST  AND  EVALUATION  MASTER  PLANS  REVIEWED 


AAAM 

DDN 

NAVSTAR 

ADDS/EPLRS 

DLSC 

PEACEKEEPER 

AEPDS 

DMSP 

ROTH-R 

AGM-130A 

DSP 

SAD ARM 

ALCM 

F-16C/D 

SDS 

AN/SQS-53C 

FMTV/PLS 

SEAWOLF  (SSN-21) 

AN/BSY-2 

HARPOON 

SINCGARS 

AN/SQR- 1 9TACTS 

LANTIRN 

SM-2 

AN/SQQ-89 

LCAC 

STINGER  RMP 

AN/SQS-53C 

M9  ACE 

T-45TS 

ASAT 

MCM 

TACIT  RAINBOW 

ATAS 

MCS 

TAOM/MCE 

ATE 

MILSTAR 

TOMAHAWK 

C-17A 

MK  37  TOMAHAWK 

csoc 

MSE 

as  well  as  21  operational  test  plans.  We 
also  prepared  and  submitted  numerous 
reports  to  OSD  Defense  Acquisition  Board 

(DAB)  principals  for  consideration 
DAB  deliberations. 
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AIM-54C 

AIM-7M  SPARROW 
AMRAAM 
AN/SQR-19 
ASPJ 

COMBAT  TALON  Q 
CORP/THEATER  ADP 


TEST  PLANS  REVIEWED 


CV-HELO  (SH-60F) 

F-14D 

F-14A 

FDS 

FMTV/PLS 

IRV 


MCS 

MILSTAR 
MK-50  TORPEDO 
ROTH-R 
SINCGARS 
SM-2 


M939A2  5  TON  TRUCK  T-45A 


The  Director  and  our  staff  assistants 
have  met  with  Service  test  agencies,  pro¬ 
gram  officials,  private-sector  organiza¬ 
tions,  and  academia;  monitored  test 
activities;  and  provided  information  to  the 
DAB  committees  as  well  as  the  DAB  prin¬ 
cipals,  the  Secretary  and  Deputy  Secretary 
of  Defense,  the  Under  Secretary  for  Ac¬ 
quisition,  and  the  Congress.  We  have  sup¬ 
ported  proceeding  with  some  programs 
and  recommended  against  proceeding  with 
others. 

During  FY88,  the  Director’s  personal 
involvement  in  T&E  activities  has  included 
28  trips,  16  of  which  were  to  test  sites  and 
military  bases.  His  first-hand  observa¬ 
tions  have  included  flying  such  aircraft  as 
the  B-1B,  the  F-15E,  the  MH-53H,  and 
the  Cobra  helicopter;  flying  with  opera¬ 
tional  AHIP  helicopter  crews  in  the  Middle 
East;  activities  on-board  surface  ships  in 
the  Mediterranean  Sea;  operations  aboard 
a  Trident  submarine;  MSE  testing  at  Fort 
Hood;  and  numerous  other  significant  test 
and  evaluation  events.  In  an  effort  to  in¬ 
crease  the  viability  and  effectiveness  of 
DoD  test  and  evaluation  programs,  he  has 
spoken  at  18  conferences,  meetings,  and 
symposia.  Audiences  at  these  speaking 
engagements  included  such  professional 
associations  as  the  American  Defense  Pre¬ 
paredness  Association,  the  Armed  Forces 
Communications  &  Electronics  Associa¬ 
tion,  the  Association  of  Old  Crows,  and 


the  International  Test  and  Evaluation  As¬ 
sociation.  He  has  represented  the  Secre¬ 
tary  of  Defense  at  such  conferences  as  the 
National  Aerospace  &  Electronics  Confer¬ 
ence  and  given  lectures  on  test  and  evalu¬ 
ation  at  the  Defense  Systems  Management 
College  and  the  Industrial  College  of  the 
Armed  Forces.  During  the  fiscal  year,  he 
has  also  formally  testified  several  times 
before  the  Congress,  and  met  on  numer¬ 
ous  occasions  with  individual  members  of 
the  Congress  and  senior  congressional 
staff  to  provide  specific  information  on 
various  emerging  weapons  systems.  To 
further  increase  the  awareness  of  the  need 
for  critical  evaluations  of  weapon  systems 
and  equipment,  he  has  provided  interviews 
to  the  news  media  and  authored  a  variety 
of  articles  to  heighten  public  awareness  of 
the  need  for  candid,  independent  assess¬ 
ments  upon  which  to  base  judgments  con¬ 
cerning  the  capability  of  DoD  systems. 

Active  on-site  participation  in  and  ob¬ 
servation  of  tests  pnd  test-related  activi¬ 
ties  remain  one  of  our  most  effective 
tools.  In  addition  to  on-site  participation, 
the  Director  and  our  staff  assistants  have 
completed  a  total  of  264  trips  to  review 
the  planning,  conduct,  and  evaluation  of 
operational  test  activities. 
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Although  security  considerations  pre¬ 
clude  identifying  them  in  this  report,  the 
number  of  Special  Access  Programs 
(SAPs)  under  DOT&E  oversight  has  in¬ 
creased  during  the  fiscal  year.  We  have 
produced  the  first  low-observables  test 
and  evaluation  security  guidelines  as  part 
of  OSD’s  SAP  policy  guidance,  and  have 
also  participated  in  a  broad  review  of 
DoD  test  resources  for  current  and  future 
low-observable  vehicles. 


The  DOT&E  staff  prepared  assess¬ 
ments  for  Defense  Acquisition  Board 
milestone  reviews  as  well  as  five  Be- 
yond-LRIP  Reports  for  the  Secretary  and 
the  Congress  during  FY88.  An  addi¬ 
tional  five  B-LRIP  reports  were  submit¬ 
ted  during  the  last  quarter  of  calendar 
year  1 988  (marked  with  an  asterisk  in  the 
chart  below). 


BEYOND-LRIP  REPORTS  SUBMITTED  TO  CONGRESS 

BIGEYE  (INTERIM)  MK-48  ADCAP* 

CV-INNER-ZONE  ASW  SH-60F  MSE* 


OH-58D  AHIP 
S-3B  WSIP 
STU-ffl* 


LANTIRN* 

M9  ACE* 

MH-53E  HELICOPTER 

The  ongoing  program-oversight  ac¬ 
tivities  of  the  DOT&E  staff  are  perhaps 
best  reflected  in  their  observations  on  the 
individual  programs  presented  in  this  re¬ 
port.  Here  are  some  of  their  comments, 
selected  from  the  program  OT&E  sum¬ 
maries  that  appear  in  the  Service  OT&E 
sections  of  this  report: 

o  To  date,  ALCM  operational 
performance  as  demonstrated  by  FOT&E 
has  met  SAC’s  requirements  for  suitabil¬ 
ity,  reliability,  and  maintainability. 

o  Test  planning  for  the  All 
Source  Analysis  System  (ASAS)  has  not 
been  adequate  to  provide  results  of  suffi¬ 
cient  quality  to  permit  informed  procure¬ 
ment  decisions.  The  Army’s  planned 
Milestone  HEB  production  decision 
should  not  be  made  without  complete 
and  adequate  OT&E. 


o  The  C-5B  performed  well  dur¬ 
ing  the  one-year  FOT&E  test  period. 

o  With  HARM  (AGM-88A), 
user  requirements  for  each  Service  are 
not  totally  met  at  this  time,  but  fixes  and 
test  of  fixes  indicate  that  the  full  require¬ 
ments  can  be  met  in  the  new  versions. 

o  Emerging  results  on  the 
M939A2  five-ton  truck  suggest  that  vari¬ 
ants  other  than  the  wrecker  go  through  a 
series  of  corrective  actions  and  check 
testing. 

o  Degraded  turning  performance 
of  the  F-16C  model  caused  by  increased 
gross  weight  and  leading  edge  flap  sched¬ 
ule  continues  to  detract  from  operational 
effectiveness. 

o  The  AN/ALQ-172  was  deter¬ 
mined  to  be  effective  against  the  tested 
threat. 
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o  Delays  in  the  development  of 
the  AN/ALQ-135  update  have  required 
postponing  operational  tests  until  1990. 

o  The  Maneuver  Control  System 
has  not  been  adequately  tested  in  the  field 
and  has  not  demonstrated  operational  ef¬ 
fectiveness  or  operational  suitability  for 
typical  users  in  typical  combat  scenarios. 

o  Slow  data  transfer  between  the 
users  is  expected  to  cause  additional  de¬ 
lays  in  completion  of  technical  testing  of 
EPLARS. 

o  No  operational  tests  on  the  AN/ 
ALQ-161  have  been  accomplished  to 
date. 

o  DOT&E  finds  the  M9  ACE  to 
be  operationally  effective  and  suitable. 

o  The  FDT&E  I  of  the  Pedestal 
Mounted  Stinger  identified  needed 
changes  to  the  training,  tactics,  and  logisti¬ 
cal  considerations  necessary  to  increase 
the  squad’s  fire  unit  performance. 

o  Continuing  problems  were  en¬ 
countered  in  maintenance  and  logistical 
support  of  the  M1A1  Abrams  main  battle 
tank. 

o  AMRAAM  missile  reliability, 
performance  in  an  ECM  environment  arid 
against  multiple  targets,  and  software  ma¬ 
turity  are  the  major  concerns  for  which 
corrections  have  been  identified,  but  re¬ 
main  to  be  tested. 

o  Production  options  for  Regency 
Net  were  exercised  before  OT&E.  Regency 
Net  OT&E  has  not  been  adequately 
planned  or  initiated. 

o  The  need  to  supply  operational 
units  with  operational  guidance  systems 
has  delayed  the  remaining  three 
Peacekeeper  test  launches 


o  The  Pioneer  RPV  system  is  mar¬ 
ginally  effective  in  providing  battle-dam¬ 
age  assessment. 

o  The  AN/ALQ-184  system  (a 
major  upgrade  to  the  AN/ALQ-119  ECM 
pod)  was  as  effective  as  the  AN/ALQ-119, 
but  did  not  meet  the  criteria  identified  in 
the  statement  of  need.  DOT&E  recom¬ 
mended  the  Air  Force  not  proceed  with 
low-rate  initial  production  until  the  effec¬ 
tiveness  deficiencies  were  corrected  and 
retested. 

o  As  tested  in  FOT&E,  the 
MH-53E  was  considered  only  marginally 
operationally  effective  and  not  operation¬ 
ally  suitable. 

o  The  STU-ffl  secure  telephone 
system  is  usable  but  needs  improvement, 
the  system  has  strong  potential  to  be  op¬ 
erationally  effective  and  suitable. 

o  Service  approval  of  the  TEMP 
and  OT  plan  for  the  Marine  Corps  Tacti¬ 
cal  Air  Operational  Center/Modular  Con¬ 
trol  Equipment  (TAOC/MCE)  is  seriously 
delinquent. 

o  The  T-45  aircraft  raised  some 
significant  safety  concerns  and  issues  in¬ 
cluding  poor  waveoff  and  bolter  perfor¬ 
mance,  inadequate  stall  warning, 
excessive  roll-off  after  stall,  and  pitch 
changes  after  speedbrake  extension  or  re¬ 
traction.  It  is  not  yet  operationally  effec¬ 
tive  in  the  carrier  environment. 

o  The  LANTRIN  system  provides 
a  night,  single-seat,  low-altitude  opera¬ 
tional  capability  that  does  not  currently  ex¬ 
ist  in  the  tactical  air  forces. 

During  the  fiscal  year,  we  have  contin¬ 
ued  to  emphasize  the  use  of  all  valid  infor¬ 
mation  for  operationally  oriented 
judgments  as  early  as  possible  during  the 
life  cycles  of  all  systems.  This  is  particu¬ 
larly  important  when  Congress  authorizes 
a  concurrent  approach  to  development  and 
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production  of  a  system,  with  significant 
funds  expended  prior  to  the  availability  of 
a  system  (or  prototype)  for  actual  opera¬ 
tional  field  testing.  In  such  cases,  we 
must  use  whatever  pertinent  information  is 


available  to  make  early  assessments  of  ex¬ 
pected  system  capabilities.  Such  informa¬ 
tion  can  include  the  output  from 
high-quality,  validated  simulators  as  well 
as  any  other  reliable  information  source. 
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This  office  is  responsible  for  approving 
the  adequacy  of  plans  for  operational  test 
and  evaluation,  and  for  reporting  to  the 
Secretary  of  Defense  and  the  Congress  the 
operational  test  results  for  all  major  de¬ 
fense  acquisition  programs.  For  DOT&E 
oversight  purposes,  major  defense  acquisi¬ 
tion  programs  were  defined  in  law  to 
mean  those  programs  meeting  the  criteria 
for  reporting  under  Section  2432,  Title  10, 
US  Code  (Selected  Acquisition  Reports 
(SARs)).  Currently,  there  are  about  114 
such  programs.  The  law 

(sec.l38(a)(2)(b))  also  stipulates  that  the 
DOT&E  may  designate  any  other  pro¬ 
grams  for  the  purpose  of  his  oversight,  re¬ 
view,  and  reporting.  With  the  addition  of 
such  “non-major”  programs,  the  DOT&E 
currently  is  cognizant  of  197  acquisition 
programs. 


Non-major  programs  are  selected  for 
DOT&E  oversight  after  careful  considera¬ 
tion  of  the  relative  importance  of  the  indi¬ 
vidual  program  and  the  workload  of  the 
responsible  staff  assistant.  In  selecting 
non-SAR  systems  for  oversight,  consid¬ 
eration  is  given  to  one  or  more  of  the  fol¬ 
lowing  essential  elements: 


o  Congress  or  OSD  agencies  have 
expressed  a  high  level  of  interest  in  the 
program. 


o  Congress  has  directed  that 
DOT&E  assess  or  report  on  the  program 
as  a  condition  for  progress  or  production. 

o  GAO  will  monitor  and/or  report 
on  operational  testing. 

o  The  program  requires  joint  or 
multi-Service  testing  (the  law 
(sec.l38(b)(4))  requires  the  DOT&E  to  co¬ 
ordinate  “testing  conducted  jointly  by 
more  than  one  military  department  or  de¬ 
fense  agency”). 

o  The  program  exceeds  or  has  the 
potential  to  exceed  the  dollar  threshold 
definition  of  a  major  program  according  to 
DoD  5000.1,  but  does  not  appear  on  the 
current  SAR  list  (e.g.,  highly  classified 
systems). 

o  The  program  has  a  close  rela¬ 
tionship  to  or  is  a  key  component  of  a  ma¬ 
jor  program. 

o  The  program  is  one  in  which  an 
existing  system  is  undergoing  major  modi¬ 
fication. 

o  The  program  is  in  trouble  or 
has  a  history  of  serious  problems. 

o  The  Service  operational  testing 
agencies  (OTAs)  have  specifically  re¬ 
quested  DOT&E  involvement. 

o  The  system  falls  under  Special 
Operations  Forces  (SOF)  purview. 


PROGRAM  OVERSIGHT 
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PROGRAMS  UNDER  DOT&E  OVERSIGHT  AS  OF  OCTOBER  1988 
A.  Programs  Meeting  the  Criteria  of  Section  2432,  Title  10,  U.S.C. 


ARMY  SteZX 


AIR  FORTE 


AAWS-H 

AAWS-M 

ADDS/EPLRS 

AFV 

AH-64  (APACHE) 

AHIP  (OH-58D) 
ASAS/ENSCE  (JTF) 
ATACMS 
ATM 

BRADLEY  FVS  (M2/M3) 
CH-47D  (CHINOOK) 
COPPERHEAD 
FAADS  (C2I,  LOS-F-H, 
LOS-R,  NLOS) 
FHTV/PLS 
FMTV 

HELLFIRE  (AGM-141A) 
LHX 

Ml  TANK/M  1 
BLOCK  2 
MLRS 

MLRS-TGW 
MS  AM 
MSE 

PATRIOT 

SADARM 

SINCGARS 

STINGER 

STINGRAY 

TOW  2 

UH-60A  (BLACKHAWK) 


AAAM 

AIM-7M  (SPARROW) 
AIM-54C  (PHOENIX) 

AIWS 

AN/BSY-1  (SSN-688  SUBACS) 
AN/BSY-2  (SSN-21  COMBAT 
SYSTEM) 

AN/SQQ-89,  AN/SQS-53C, 
AN/SQR-19  TACTAS 
ASPJ(ALQ-165) 

AV-8B 

A-6E/F 

BATTLESHIP  REACTIVATION 

CG-47  AEGIS 

CIWS  (PHALANX) 

CVN-72/73/74/75 

C/MH-53E 

DDG-5 1 

EA-6B 

E-2C 

E-6A  (TACAMO) 

FDS 

F-14 

F/A-18 

HARM  (AGM-88A) 

HARPOON 
LAMPS  MK  III 
LCAC 
LHD 
LRAACA 

LSD-4  l/LSD-41  CV 
MK-48  ADCAP 
MK-50  TORPEDO  (ALWT) 
NATO  AAWS 
P-3C 

SEA  LANCE  (ASW  SOW) 
SH-60F  (CV  HELO) 

SSN-21 

SSN-688 

STANDARD  MISSILE  (SM-2) 
T-45TS 

TAO  FLEET  OILER 
TOMAHAWK  (BGM-109) 
TRIDENT  II  MISSILE 
TRIDENT  II  SUBMARINE 
UHF  FOLLOW-ON  COMM 
V-22 

V-22  ASW  VARIANT 


ADI 

AMRAAM  (AIM-120A) 
ATARS 

ATF  (INEWS/ICNIA) 

B-1B 

C-5B 

C-17A 

CIS  (MARK  XV  IFF) 

DMSP 

DSCS  III 

DSP 

F-15 

F-16 

GLCM 

IUS  (SPACE  SHUTTLE) 

JSTARS 

JTIDS 

LANTIRN 

MAVERICK  (AGM-65G) 

MILSTAR 

MLS 

NASP 

NAVSTAR  OPS 
OTH-B 

PEACEKEEPER 
PEACEKEEPER  RAIL 
GARRISON 
SFW 

SMALL  ICBM 
SRAM  II 

TACIT  RAINBOW 
TITAN  IV  (CELV) 
TRI-TAC 
WIS 


U£A 


h&a 


OTHER 


DMS 


AF.PDS 


SDI/SDS 
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PROGRAMS  UNDER  DOT&E  OVERSIGHT  AS  OF  OCTOBER  1988 
B.  Programs  Designated  in  Accordance  with  Section  138,  Title  10,  U.S.C. 


ARM! 


AIRFORCE 


9MM  PER  DEF  WEAPON 

AFATADS 

ALQ-136 

APR-39 

FOTL 

HMMWV 

M109A2  155MM  (HIP) 

M88A1 

M9  ACE 

M939A2  5-TON  TRUCK 
MCS 

PERSHING  II 
REGENCY  NET 
UAV 
ULCS 


ALR-67  (F— 18) 

AN/SWW-891  (IMPROV  PROG) 
ATA 

BIGEYE  (BLU-80B) 

FFG-7 

IMPROVED  LINK  II 

MCM 

MHC 

N-RO<!^ 

RAM  (RIM-116A) 

ROTH-R 

RPVs 

S-3B 

SPY-1  B/D  (AEGIS) 
SUBMARINE  LASER  COMM 
SWCM 
TAOC/MCE 

VERTICAL  LAUNCH  ASROC 


ACM 

AGM-130  (POWERED) 
ALCM 

ALQ-131  JAMMER  R/P 

ALQ-135  UPDATE 

ALQ-161  (Bl-B) 

ALQ-172  (B-52H) 

ALQ-184  JAMMER 

ALR-56C  (F-15E) 

ALR-62I  (F— 1 1 1) 

ALR-74/56M 

ALS 

ASAT 

ATB 

CSOC 

E—3A 

EF-111A  (TJS) 

EPW 

MC-130H 
MMIII  PEN  AIDS 
NWS 
SRAM  T 
WWABNCP 


U£A 


USA 


MATO  COOPERATIVE 


DDN 


FSVS/STU-III 


AIOS 

LEGUAN  BRIDGE 
RAVEN  UAV 
SPRITE  RPH 


OTHER 

AIRSHIP 

MAISRC  PROGRAM 
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POLICY  AND  RESOURCE  MANAGEMENT 


POLICY  INITIATIVES 


The  Test  and  Evaluation  Committee 
(TEC),  chartered  under  DoD  Instruction 
5000.2  to  identify  and  resolve  resource 
and  policy  issues  in  the  T&E  arena,  has 
provided  the  forum  and  expertise  for  fo¬ 
cus  and  direction  of  T&E  policy  within 
DoD.  The  TEC  addressed  four  sets  of 
T&E  policy  issues  presented  by  the  Serv¬ 
ices  in  the  TEC  organizational  meeting: 
live-fire  and  joint  live-fire  testing,  realis¬ 
tic  testing  and  modeling  and  simulation, 
T&E  resources  and  budget,  and  contractor 
involvement  in  operational  test  and  evalu- 
,  ation.  The  TEC  also  addressed  additional 
issues  as  they  surfaced  during  the  year. 

The  Test  and  Evaluation  Symposium 
conducted  on  June  1-2,  1988,  jointly  spon¬ 
sored  by  DOT&E  and  DDDR&E  (T&E), 
provided  additional  focus  to  T&E  policy  is¬ 
sues.  Over  150  senior  level  OSD  and 
Service  personnel  participated,  as  panels 
discussed  a  number  of  important  test  pol¬ 
icy  issues,  including  Test  and  Evaluation 
~  Master  Plans  (TEMPs),  trends  in  range 
~and  facilities  capabilities/T&E  budget 
trends,  live-fire  testing,  performance  of 
Early  Operational  Assessments,  the  future 
of  air  defense  threat  simulators,  and  con¬ 
tractor  involvement  in  operational  testing. 

Additional  issues  addressed  here  in¬ 
clude  establishment  of  the  DOT&E  Deputy 
for  Strategic  Systems,  preparation  of  a 
plan  for  operational  suitability  assess¬ 
ments,  formalization  of  the  Foreign  Weap¬ 
ons  Evaluation  and  NATO  Comparative 
Test  programs,  modeling  and  simulation 
in  support  of  OT&E,  responses  to  a  wide 
variety  of  GAO  concerns,  and  formulation 
and  publication  of  numerous  T&E  guid¬ 
ance  documents. 

TEST  AND  EVALUATION  COMMIT¬ 
TEE 

The  TEC  is  chartered  under  DoD  instruc¬ 
tion  5000.2  to  identify  and  resolve  re¬ 


source  and  policy  issues  in  the  T&E  arena. 
The  DOT&E  chairs  the  committee,  and  the 
DDDR&E  (T&E)  is  vice-chairman.  TEC 
panels  were  established  to  resolve  the  fol¬ 
lowing  four  issues: 

Live-fire  and  Joint  Live-fire  Testing. 
Policy  implementing  PL  99-661  as 
amended  by  the  FY86,  FY87,  and  FY88 
DoD  Authorization  acts  was  promulgated 
with  the  publication  of  the  “Live-Fire  Test 
and  Evaluation  Guidelines’*  on  June  1, 
1988.  These  guidelines  provide  for  a 
timely  and  thorough  assessment  of  the  vul¬ 
nerability/lethality  of  a  system  as  it  pro¬ 
gresses  through  its  development  and  sub¬ 
sequent  production  phases.  Live-fire  test 
planning  will  be  documented  in  program 
TEMPs. 

Realistic  Testing  and  Modeling  and  Simu¬ 
lation.  The  state  of  the  art  in  simulation 
is  still  evolving  and  continues  to  be  the 
subject  of  discussion  and  debate.  It  is 
clear,  however,  that  the  application  of  sol¬ 
idly  validated  modeling  and  simulation  to 
operational  test  and  evaluation  is  on  the 
rise,  especially  where  there  are  constraints 
placed  on  OT&E  for  reasons  of  cost, 
safety,  security,  limited  assets,  treaties, 
and  concurrency.  The  need  for  Early  Op¬ 
erational  Assessments  (EOAs)  to  support 
major  milestone  decisions  prior  to  the 
availability  of  production-representative 
test  articles  also  increases  the  importance 
of  modeling  and  simulation.  It  is  thus 
essential  that  the  models  and  simulations 
employed  and  the  results  derived  from 
them  be  both  valid  and  credible. 

For  these  reasons,  the  Secretary  of  De¬ 
fense  tasked  this  office  .to  develop  DoD- 
level  guidance  on  the  application  of  mod¬ 
eling  and  simulation  to  operational  test 
and  evaluation.  In  July  198$,  we  asked 
the  Services  and  defense  agencies  to  assist 
in  the  preparation  of  a  draft  guidance 
document  on  the  application  of  modeling 
and  simulation  to  OT&E,  including  guid- 
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ance  on  establishing  credibility  of  those 
simulations.  In  August,  we  conducted  a 
very  successful  two-day  workshop  (with 
representatives  from  all  Services,  other 
OSD  offices  and  defense  agencies,  and 
private  industry)  to  elicit  tind  combine 
Service  and  DoD  agency  concerns,  policy 
guidance,  and  methodologies,,  for  the  pur¬ 
pose  of  incorporating  these  into  a  draft 
“for  comment”  document.  The  draft  guid¬ 
ance  document  was  derived  directly  from 
the  workshop  output,  and  has  been  for¬ 
warded  to  the  Services  for  formal  com¬ 
ment.  After  formal  comments  have  been 
gathered,  we  will  conduct  a  follow-up 
workshop  (in  mid-January  1989)  to  recon¬ 
cile  the  Service  comments.  Subsequently, 
formal  guidance,  will  be  published  by  the 
DOT&E.  In  the  meantime,  the  draft  docu¬ 
ment  is  serving  as  an  interim  guide  to  the 
Services,  providing  a  framework  to  ad¬ 
dress  the  credibility  and  validation  of 
weapon  systems  models  and  simulations. 


T&E  Resources  and  Budget.  In  accor¬ 
dance  with  House  Report  100-410,  which 
directed  DoD  to  develop  a  management 
plan  for  the  Major  Range  and  Test  Facility 
Base  (MRTFE),  the  TEC  established  pri¬ 
orities  and  the  mechanism  for  monitoring 
execution  of  the  MRTFB  Improvement  and 
Modernization  Program.  The  resource 
panel  of  the  TEC  was  responsible  for  de¬ 
velopment  of  the  management  plan. 


In  April  1988  Congress  was  provided  a 
report  describing  the  concept  for  manag¬ 
ing  DoD  test  capabilities.  This  report  pro¬ 
vided  a  description  of  the  MRTFB,  history 
leading  to  its  formation,  management  re¬ 
sponsibilities,  discussion  of  congressional 
concerns,  and  an  outline  of  the  OSD  near 
and  long-range  concept  for  addressing 
congressional  concerns.  In  September 
1988,  an  additional  report  was  submitted 
which  detailed  DoD  implementation  of  the 
concept,  including  specific  actions  and 


milestones  for  accomplishing  the  activities 
identified  in  the  concept  report. 

The  TEC  will  provide  the  DoD  a  corpo¬ 
rate  mechanism  to  coordinate  manage- 
mentof  not  only  the  currently  defined 
MRTFB,  but  a  new,  broader  concept  em¬ 
bracing  all  elements  necessary  to  establish 
a  National  Test  Capability  Base  (NTCB). 
This  NTCB  will  encompass  the  newly  de¬ 
fined  MRTFB,  as  well  as  elements  from 
other  government  organizations,  acade¬ 
mia,  and  the  private  sector  which  can  sup¬ 
port  DoD’s  testing  needs.  The  submission 
of  the  management  plan  is  a  first  step  to¬ 
ward  attaining  this  national  capability. 

Contractor  Involvement  in  Operational 
Test  and  Evaluation.  The  restrictions 
with  respect  to  system-contractor  involve¬ 
ment  in  OT&E,  as  contained  in  10  U.S.C. 
2366,  continue  to  generate  significant  in¬ 
terest  in  DoD  and  in  the  Congress.  The 
interpretation  of  this  law — specifically 
paragraphs  (a)(1)(C)  and  (b)(2),  which 
address  system  contractor  involvement  in 
OT&E — can  and  have  had  a  major  impact 
on  the  conduct  of  initial  operational  test 
and  evaluation  (IOT&E). 

Clearly,  a  contractor  whose  system  is 
being  testa!  must  not  be  allowed  to  influ¬ 
ence  the  conduct  or  outcome  of  testing  or 
the  analysis  and  evaluation  of  test  data. 
However,  there  is  serious  concern  that  th  e 
current  law  provisions  are  too  sweepirg 
and  vague.  As  a  result,  the  TEC  is  evalu¬ 
ating  alternative  approaches.  It  is  ex¬ 
pected  that  proposals  will  be  forwarded  lo 
Congress  for  consideration  early  in  1989. 

T&E  SYMPOSIUM 

The  T&E  Symposium,  the  second  to  be 
jointly  sponsored  by  DOT&E  and 
DDDR&Efr&E),  was  an  excellent  forum 
for  discussion  of  T&E  issues.  Panel  dis¬ 
cussions  provided  a  good  format  to  review 
the  previously  mentioned  policy  issues  be- 
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tool  in  making  soui.;1  production  deci¬ 
sions. 

Air  Defense  Threat  Simulators.  OSD  will 
accomplish  its  joals  in  air  defense  threat 
simulator  development  by  expanding  its 
role  in  three  areas.  The  Executive  Com¬ 
mittee  for  Threat  Simulators  (EXCOM) 
will  operate  under  a  new  charter  and  pro¬ 
vide  the  guidance  necessary  to  meet  re¬ 
quirements  while  eliminating  duplication. 
Work  which  has  been  done  on  future 
range  improvements  will  be  coordinated 
with  the  work  of  the  EXCOM  to  insure 
that  programs  and  budgets  are  synchro¬ 
nized.  Finally,  the  TEC  will  serve  as  the 
•  focal  point  to  give  visibility  to  the  require¬ 
ments  for  realistic  testing  and  provide  dis¬ 
cipline  to  avoid  unnecessary  duplication. 

ADDITIONAL  POLICY  ISSUES 

Strategic  Systems  Oversight.  As  reported 
in  last  year’s  Annual  Report,  at  the  direc¬ 
tion  of  the  Secretary  of  Defense,  DOT&E 
began  an  initiative  to  facilitate  the  conduct 
of  early  operational  assessments  of  the 
Strategic  Defense  System  (SDS).  Based  on 
that  direction  and  congressional  language 
included  in  the  Conference  Report  on  the 
FY89  DoD  Authorization  Act,  we  estab¬ 
lished  a  deputy  director  responsible  for 
oversight  of  those  strategic  and  ..pace  sys¬ 
tems  programs  under  the  cognizance  of 
the  Defense  Acquisition  Board’s  Strategic 
Systems  Committee. 

While  the  new  Deputy  for  Strategic 
Systems  actively  pursues  OT&E  oversight 
of  all  strategic  systems  -  e.g.,  B-1B,  Small 
ICBM,  and  Anti-Satellite  (ASAT)  sys¬ 
tems  -  he  has  begun  a  major  effort  to  ad¬ 
dress  OT&E  concerns  for  the  Strategic  De¬ 
fense  System.  The  primary  focus  of  this 
effort  is  to  establish  a  capability  to  provide 
the  Congress  and  the  Defense  Acquisition 
Board  with  timely  independent  assess¬ 
ments  of  the  potential  military  usefulness 
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of  the  Phase  I  Strategic  Defense  System. 
During  FY88,  we  concentrated  on  estab¬ 
lishing  the  requirements  for  OT&E-related 
resources  and  building  organizational  rela¬ 
tionships  and  procedures  which  will  facili¬ 
tate  the  conduct  of  independent  assess¬ 
ments  of  the  SDS  programs.  We  have 
developed  institutional  relationships  with 
each  Service  OTA  to  ensure  a  thorough 
and  comprehensive  understanding  of  these 
complex  national  programs. 

Our  first  contribution  was  to  identify 
some  disconnects  in  the  SDS  program  for 
the  DAB  meeting  held  in  September  1988. 
The  thrust  of  our  findings  concerned  the 
need  for  more  attention  in  the  targets  area 
and  differences  between  the  proposed  con¬ 
cept  of  operations  and  the  evolving  Phase  I 
architecture. 


The  relationships  forged  between  the 
Services  and  DOT&E  which  will  be  neces¬ 
sary  to  perform  Early  Operational  Assess¬ 
ments  of  the  SDS  program  have  been 
spelled  out  in  a  memorandum  of  under¬ 
standing  (MOU)  between  the  Service  sec¬ 
retaries  and  the  Director,  OT&E.  This 
MOU,  which  covers  roles,  missions,  and 
responsibilities,  will  be  signed  and  imple¬ 
mented  in  early  1989. 

Operational  Suitability  Assessment.  Dur¬ 
ing  the  last  few  years,  the  DoD  has  in¬ 
creased  its  focus  on  the  reliability,  main¬ 
tainability,  and  support  aspects  of  new 
DoD  systems.  In  the  operational  testing 
arena,  the  assessment  area  for  these  topics 
is  operational  suitability,  that  is,  the  ability 
to  place  a  system  satisfactorily  into  field 
use,  considering  reliability,  maintainabil¬ 
ity,  availability,  and  alt  of  the  required 
support  elements.  During  FY88,  DOT&E 
initiated  an  effort  to  place  more  directed 
attention  on  this  aspect  of  OT&E  activi¬ 
ties.  We  added  a  specialist  for  operational 
suitability  to  our  staff,  and  we  developed  a 
plan  for  operational  suitability  assessment 
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ing  addressed  by  the  TEC  as  well  as  the 
following  T&E  policy  issues. 

TEMPs.  The  TEMP  was  generally  recog¬ 
nized  as  a  valuable  top-level  document, 
suitable  for  overall  program  test  planning 
throughout  the  acquisition  cycle.  Recom¬ 
mended  changes  in  TEMP  length,  the  re¬ 
view  and  approval  process,  update  re¬ 
quirements  and  resource  identification  will 
be  addressed  in  the  revision  of  DoD 
5000.3-M-l,  “Test  and  Evaluation  Master 
Plan  Guidelines,"  which  will  be  published 
in  1989. 

Performance  of  Early  Operational  As¬ 
sessments  (EOAs).  For  many  years  the 
operational  test  community  has  been 
urged  by  both  DoD  and  Congress  to  get 
involved  earlier  in  the  acquisition  process. 
The  traditional  approach  to  OT&E,  in 
which  the  tester  takes  a  production- 
representative  system  and  evaluates  opera¬ 
tional  effectiveness  and  suitability  in  a  re¬ 
alistic  environment,  under  combat  stress, 
with  representative  personnel  operating 
and  maintaining  it,  is  still  a  valid,  abso¬ 
lutely  essential  approach.  It  provides  solid 
answers  to  questions  of  effectiveness  in 
the  field  and  extremely  important  input  to 
the  production/deployment  decision  proc¬ 
ess.  However,  the  pressure  for  early 
OT&E  community  involvement  stems  from 
the  decision  makers’  very  real  need  for  ob¬ 
jective,  operationally  oriented  information 
to  make  informed  decisions  during  the 
concept  demonstration/validation  and  full- 
scale  development  phases  of  acquisition. 
These  decisions  are  concerned  with  deter¬ 
mining  whether  or  not  the  program  is  on 
the  right  track  toward  ultimately  yielding 
an  operationally  effective  and  suitable  sys¬ 
tem.  The  more  integral  development/pro¬ 
duction  concurrency  becomes  a  part  of  a 
system’s  acquisition  strategy,  the  more 
critical  these  decisions  become.  From  the 
decision  maker’s  viewpoint,  EOAs  are  ex¬ 
tremely  important  because  they  can  iden¬ 
tify  areas  of  risk  before  significant  money 


has  been  spent  and  the  program  has  gone 
down  the  wrong  track  for  so  long  that  it 
must  be  cancelled. 

If  traditional  dedicated  OT&E  is  the 
“final  exam”  for  a  preproduction  decision, 
then  EOAs  should  be  viewed  as  “periodic 
quizzes”  leading  up  to  this  exam.  They 
provide  a  means  of  assuring  decision  mak¬ 
ers  that  the  system  is  being  prepared  for 
the  final  exam  and  that  operational  effec¬ 
tiveness  and  suitability  shortfalls  are  being 
identified  and  corrected  early  on.  EOAs 
are  tools  to  “guide”  not  to  “decide." 

The  C-17A  was  the  first  major  acquisi¬ 
tion  program  to  present  an  EOA  to  this 
office  as  a  decision-making  tool.  Using 
the  Critical  Operational  Issues  from  the 
Test  and  Evaluation  Master  Plan  as  a 
“framework,"  the  EOA  highlighted  areas 
of  risk  that  could  affect  the  overall  opera¬ 
tional  capabilities  of  the  C-17A.  This  was 
the  first  in  a  series  of  C-17A  EOAs  that 
will  be  updated  and  presented  annually. 
Guidelines  that  can  be  used  by  the  Service 
operational  test  agencies  to  standardize 
the  format  and  content  of  Early  Opera¬ 
tional  Assessments  are  being  developed. 

The  System  Maturity  Matrix  was  devel¬ 
oped  as  an  adjunct  to  the  EOA.  This  docu¬ 
ment  outlines  the  testing/demonstrated  ca¬ 
pability  available  to  support  major 
production  decisions.  The  maturity  matrix 
is  not  intended  to  set  pass/fail  criteria,  but 
rather  to  permit  a  qualitative  assessment 
of  a  system’s  progress. 

After  several  months  of  coordination 
between  DOT&E  and  the  Air  Staff,  the  fi¬ 
nal  iteration  of  the  B-2  System  Maturity 
Matrix  was  approved.  This  matrix  ad¬ 
dresses  the  aircraft’s  mission  perform¬ 
ance,  low  observability,  vehicle  perform¬ 
ance,  integrated  logistics  support,  mission 
planning  system,  and  training  systems. 
This  document  will  be  an  example  for 
other  acquisition  systems  to  emulate,  and 
should  prove  to  be  an  extremely  useful 
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which  will  guide  our  efforts  to  improve 
our  work  in  this  very  important  area. 

Foreign  Weapons  Evaluation  Program. 
The  Foreign  Weapons  Evaluation  (FWE) 
Program  is  designed  to  support  the  evalu¬ 
ation  of  a  foreign  nation’s  weapon  sys¬ 
tems,  equipment,  or  technology  in  terms 
of  its  potential  to  meet  a  valid  requirement 
of  one  or  more  of  the  US  Armed  Services. 
Goals  of  the  FWE  program  include  avoid¬ 
ing  unnecessary  duplication  in  develop¬ 
ment,  enhancing  standardization  and  inter¬ 
operability,  ana  promoting  international 
technology  exchanges.  The  FWE  program 
is  not  intended  for  use  in  exploiting  threat 
systems  or  for  intelligence  gathering  pur¬ 
poses.  The  primary  objective  of  the  pro¬ 
gram  is  to  reduce  the  costs  of  research 
and  development,  while  leading  to  the  ac¬ 
quisition  of  foreign  equipment  for  US  use. 
Policy  and  procedures  for  the  execution  of 
the  FWE  program  are  documented  in  DoD 
5000.3-M-2. 

Foreign  weapons  evaluation  activities 
and  responsibilities  were  assigned  to  the 
Director  Defense  Test  and  Evaluation 
(now  Deputy  Director  Defense  Research 
and  Engineering  (Test  and  Evaluation) 

g)DDR&E(T&E)))  by  direction  of  the 
ongress  in  1980.  Each  year,  sponsoring 
military  services  forward  to  the  DDDR&E- 
T&E)  candidate  nomination  proposals 
CNPs)  for  systems  to  be  evaluated  under 
the  FWE  program. 

The  fundamental  criterion  for  FWE 
program  selection  is  the  candidate  sys¬ 
tem's  potential  to  satisfy  an  existing  or 
projected  operational  or  training  require¬ 
ment  or  its  possible  contribution  to  the  US 
technology  case.  Additional  factors  influ¬ 
encing  candidate  selection  include  the  fol¬ 
lowing:  candidate  maturity,  available  test 
data,  multi-Service  interest,  existence  of  a 
statement  of  operational  requirement 
need,  potential  for  subseauent  procure¬ 
ment,  sponsorship  by  a  US-based  licen¬ 


see,  a  realistic  evaluation  schedule,  a  DoD 
component  cost-sharing  proposal,  and 
preprogrammed  procurement  funds.  For 
technology  evaluation  programs  within  the 
FWE  program,  the  candidate  nomination 
proposal  must  address  the  specific  ar¬ 
rangements  under  which  the  US  and  for¬ 
eign  participants  (governments,  armed 
forces,  corporations)  will  operate.  These 
may  include  government-to-government 
memoranda  of  agreement,  private  industry 
licensing  agreements,  data  exchange 
agreements,  and/or  cooperative  technology 
exchange  programs. 

Foreign  weapons  evaluation  projects 
are  funded  by  OSD  and  executed  by  the 
Services.  Points  of  contact  at  the  head¬ 
quarters  level  in  each  of  the  Services 
monitor  the  conduct  of  the  programs. 
Work  is  performed  in  laboratories  and  test 
centers  throughout  the  country. 

NATO  Comparative  Test  Program.  The 
NATO  Comparative  Test  Program  is  simi¬ 
lar  to  the  FWE  program.  It  was  created 
by  Congress  in  the  FY86  Defense  Authori¬ 
zation  Act.  The  program  supports  the 
evaluation  of  NATO  weapon  systems, 
equipment,  and  technology  and  assesses 
their  suitability  for  use  by  US  forces.  The 
selection  criteria  for  the  NATO 
Comparative  Test  Program  are  essentially 
the  same  as  for  the  FWE  program,  with 
the  exception  that  the  equipment  must  be 
roduced  by  a  NATO  member  nation  and 
e  considered  either  as  an  alternative  to  a 
system  in  the  late  stage  of  development  in 
the  US,  or  to  offer  a  cost,  schedule,  or 
performance  advantage  over  US  equip¬ 
ment.  In  addition,  the  program  requires 
that  notification  be  sent  to  the  Armed 
Services  and  Appropriations  committees 
of  the  House  of  Representatives  and  Sen¬ 
ate  before  funds  are  obligated.  With  this 
exception,  the  program  follows  the  same 
nomination  process  and  administrative 
procedures  as  the  Foreign  Weapons  Evalu¬ 
ation  Program.  Guidelines  for  the  program 
are  contained  in  DoD  5000.3-M-2.  DoD 
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directive  2010.6  instructs  the  DoD  in  how 
to  comply  with  the  iaw. 

This  office  has  participated  actively  in 
the  Foreign  Weapons  Evaluation  and 
NATO  Comparative  Test  programs  during 
FY88  and  during  the  FY89  selection  proc¬ 
ess.  Si;.ty-one  projects  were  reviewed  as 
potential  candidates  for  these  programs  in 
FY89.  A  DOT&E  staff  specialist  sits  on 
the  FWE/NCT  Review  and  Selection  Com¬ 
mittee  to  determine  which  projects  should 
be  approved  and  which  should  be  rejected. 

Three  FWE/NCT  projects  were  ele¬ 
vated  to  the  DOT&E  oversight  list:  The 
Navy’s  Action  Information  System 
(AIOS),  the  USAF  Sprite  unmanned  aerial 
vehicle  (UAV)  and  the  Army’s  evaluation 
of  the  Raven  UAV.  Both  the  Sprite  and 
Raven  evaluations  are  being  evaluated 
within  the  framework  of  the  UAV  Joint 
Project  Office. 

Responses  to  GAO.  During  the  past  year, 
the  GAO  caseload  of  reviews,  studies,  and 
investigations  has  escalated  geometrically. 
This  has  required  the  DOT&E  staff  to  ex¬ 
pend  between  5200  and  7800  manhours  on 
GAO  and  DoD  Inspector  General  matters 
during  FY88.  This  translates  to  nearly 
four  DOT&E  staff  people  (over  10%  of 
our  professional  staff)  working  full  time 
for  a  year  for  the  GAO  and  DoDIG. 

The  Beyond  Low-Rate  Initial  Production 
Report.  The  B-LRIP  Report  is  one  of  the 
most  important  products  of  this  office.  It 
is  necessary,  therefore,  to  maintain  a  con¬ 


sistent  methodology  for  producing  the  re¬ 
port.  In  response  to  this  need,  a  “Guide  to 
Preparing  B-LRIP  Reports”  was  developed 
to  facilitate  and  standardize  our  B-LRIP 
report  preparation  and  publication  proce¬ 
dures.  It  contains  specific  guidance  on 
considerations  to  be  included  in  the  body 
of  every  B-LRIP  Report.  Beginning  with 
this  edition,  all  B-LRIP  reports  will  be  in¬ 
cluded  in  an  appendix  to  our  Annual  Re¬ 
port. 

T&E  Guidance.  The  following  T&E  guid¬ 
ance  documents  were  coordinated  and 
published  during  the  past  year: 

o  DoD  5009.3-M-l,  Change  1, 
“Test  and  Evaluation  Master  Plan  (TEMP) 
Guidelines,”  February  5,  1988. 

o  DoD  5000.3-M-2,  “The  Depart¬ 
ment  of  Defense  Foreign  Weapons  Evalu¬ 
ation  Program  and  NATO  Comparative 
Test  Program  Procedures  Manual,’’ 
August  1988. 

o  DoD  5000.3-M-4,  “Joint  Test 
and  Evaluation  Procedures  Manual,” 
August  1988. 

o  “Live  Fire  Test  and  Evaluation 
Guidelines,”  June  1,  1988. 

0  “Operational  Test  and  Evalu¬ 
ation  Staff  Orientation  and  Information 
Guide,"  September  1988. 

o  “Guide  to  Preparing  B-LRIP  Re¬ 
port,”  December  1988. 
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INTRODUCTION 

As  much  as  the  FY89  budget  year  was  de¬ 
scribed  as  an  off  year  in  the  biennial 
budget  cycle,  the  FY90-91  cycle  during 
FY88  was  an  “on  year.”  Major  forward 
looking  management  initiatives  have  been 
undertaken  and  resource  decisions  made. 
In  contrast,  congressional  restrictions  have 
significantly  affected  our  ability  to  im¬ 
prove  the  lot  of  the  operational  tester  and 
to  improve  realism  in  near  term 
(FY89-90)  operational  tests. 

The  Test  and  Evaluation  Management 
and  Investment  Initiative  (TEMI),  de¬ 
scribed  in  last  year’s  report,  has  culmi¬ 
nated  in  major  resource  management  pol¬ 
icy  changes  and  a  decision  to  add 
significant  resources  to  an  OSD  program 
element  (PE)  for  test  investment.  Re¬ 
source  management  policy  changes,  origi¬ 
nally  discussed  under  TEMI,  gathered  new 
momentum  as  a  result  of  the  House  Re¬ 
port  100-410  directing  development  of  a 
management  plan  for  the  Major  Range 
and  Test  Facility  Base  (MRTFB).  In  the 
Department’s  response,  “Management 
Plan  For  the  MRTFB,”  jointly  developed  by 
DOT.fcE  and  DDDR&E(T&E)  and  for¬ 
warded  to  the  Congress  on  October  1, 
1988,  the  Test  and  Evaluation  Committee 
(TEC)  of  the  Defense  Acquisition  Board 
was  officially  installed  as  the  cornerstone 
of  a  new  corporate  T&E  resource  manage¬ 
ment  approach,  embracing  the  broader 
concept  of  a  National  Test  Capability  Base 
(NTCB).  Key  elements  of  the  plan  call  for 
review  and  recomposition  of  the  MRTFB, 
development  of  a  T&E  capabilities  data 
base,  uniform  workload  and  utilization 
measurement,  development  of  a  test  re¬ 
source  master  plan,  and  formulation  of 
zero-generation  and  follow-on  corporate 
biennial  T&E  budgets.  The  TEMI  require¬ 
ments  review  that  identified  approximately 
$12  billion  in  T&E  needs  (capability  short¬ 


falls)  over  the  FY88-94  period  mentioned 
in  last  year’s  report  transitioned  to  the 
“T&E  Capabilities  Issue,”  which  was  dis¬ 
cussed  during  the  FY90-91  program  re¬ 
view,  resulting  in  a  Deputy  Secretary  of 
Defense  decision  to  add  $1.3  billion  for 
test  investment  over  the  FY90-94  Five 
Year  Defense  Plan  (FYDP). 

The  Space  Systems  Test  Capability 
(SSTC)  study  and  revalidation  effort,  ref¬ 
erenced  in  our  FY87  Annual  Report,  was 
captured  as  a  part  of  the  T&E  Capabilities 
Issue.  Therefore,  the  Deputy  Secretary’s 
decision  was  based  on  the  broadest  possi¬ 
ble  review  of  DoD  test  resource  needs. 
Consequently,  funding  to  design  and  pro¬ 
vide  the  capability  to  support  more  rigor¬ 
ous  and  stressful  testing  of  the  next  and 
current  generation  of  aerospace  system  is 
included  in  the  $1.3  billion  line. 

The  Operational  Test  and  Evaluation 
Capability  Improvement  Program  (OT&E 
CIP)  has  enjoyed  considerable  success  in 
its  first  execution  year.  This  is  measured 
not  only  in  the  attainment  of  operational 
test  and  evaluation  capabilities,  but  also  in 
the  reinforcement  of  our  ability  to  exercise 
certa;n  managerial  prerogatives  which 
have  enhanced  substantially  our  ability  to 
improve  scheduled  operational  tests.  That 
is,  the  acquisition  of  threat  resources 
(ground  and  airborne)  has  provided  added 
leverage  to  enforcement  of  our  authority 
to  direct  improved  fidelity  and  realism  in  a 
test.  Before,  we  were  dealing  only  with 
Service  funds  and  test  resources.  Now, 
although  we  are  just  beginning,  we  can 
bring  resources  to  the  table. 

All  in  all,  FY  1988  has  been  a  banner 
year  for  T&E  resource  management.  The 
DoD  has  initiated  the  bold  steps  needed  to 
manage  T&E  resources  adequately  into  the 
1990s  and  beyond. 
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TEST  AND  EVALUATION  CAPABILI¬ 
TIES  ISSUE 

The  requirements  analysis  conducted  un¬ 
der  the  TEMI  formed  the  basis  for  the 
subject  issue  paper,  which  was  discussed 
during  the  Department’s  review  of  the 
FY90-91  budget  by  the  Defense  Resources 
Board  (DRB)  in  June  and  July  of  198%.. 
As  chairman  of  the  TEC  and  the  only  T&E 
representative  on  the  DRB,  the  Pjmctor 
presented  the  arguments  for  the  issue-  Af¬ 
ter  hearing  all  views,  pro  and  con,  the 
Deputy  Secretary  directed  the  Services  to 
revalidate  the  merits  of  the  needs  (all  un¬ 
funded)  submitted,  particularly  as  they  re¬ 
lated  to  their  funded  budgets.  This  revali¬ 
dation  was  completed  in  fall  1988,  and  a 
decision  rendered  by  the  Deputy  Secretary 
on  November  9,  1988,  to  establish  a  cen¬ 
tral  (OSD-level)  T&E  investment  program 
element  (PE).  The  funding  approved  was 
added  to  an  already  existing  OSD  PE 
(060490D,  Test  Instrumentation  Develop¬ 
ment)  in  the  Deputy  Director  Defense  Re¬ 
search  and  Engineering  (Test  and  Evalu¬ 
ation)  (DDDR&E(T&E))  appropriation.  A 
brief  discussion  of  the  PE  and  the  back¬ 
ground  and  rationale  for  the  central  invest¬ 
ment  line  follow. 

In  FY88,  program  element  060490D 
was  established  to  consolidate  funds  for 
DoD-wide  development,  demonstration, 
and  integration  of  GPS-based  range  in¬ 
strumentation  to  provide  interoperability 
and  meet  more  stringent  demands  for  in¬ 
creased  accuracy  m  time,  space,  position¬ 
ing  information  for  testing.  The  Depart¬ 
ment’s  decision  to  centrally  fund  the  most 
critical  needs,  derived  from  the  analysis  of 
current  and  projected  T&E  capability  re¬ 
quirements,  cited  above  and  discussed  be¬ 
low,  builds  upon  the  precedent  established 
in  FY88. 

The  increase  in  this  overall  program 
element  (+$148  million  in  FY90,  +$263 
million  in  FY91)  results  from  the  comple¬ 
tion  of  a  two-and-one-half-year  DoD- 


wide  review  and  analysis  of  T&E  capabil¬ 
ity  needs  and  investment  trends.  It  is  the 
beginning  of  an  OSD-level  initiative  to  re¬ 
dress  the  most  critical  needs  identified. 
The  review  (previously  referred  to  as 
TEMI),  directed  by  the  Deputy  Secretary 
of  Defense  in  the  summer  of  1986,  identi¬ 
fied  more  than  $15  billion  in  total  require¬ 
ments  over  the  FY88-94  time  period. 
When  unwarranted  duplication,  clearly  un¬ 
executable  investment  proposals,  and 
needs  that  could  not  be  tied  to  programs 
or  funded  technology  thrusts  were  elimi¬ 
nated,  the  result  was  a  validated  $12  bil¬ 
lion  T&E  capability  shortfall  that  touched 
virtually  all  areas  of  the  DoD  test  capabil¬ 
ity  base.  In  addition,  analysis  of  invest¬ 
ment  trends  over  the  past  ten  years 
showed  no  real  growth  in  test  investment 
when  R&D  in  general  and  technology  driv¬ 
ers  (e.g.,  smart  munitions,  totally  inte¬ 
grated  systems,  high  speed  computers, 
high  resolution  sensors,  directed  energy, 
increased  nuclear  hardening  requirements, 
low  observables,  hypersonics,  etc.)  in  par¬ 
ticular  experienced  significant  real  growth. 
Clearly,  the  analysis  demonstrated  that 
test  investment  in  the  Department  was 
“broken."  These  results  were  discussed 
by  the  DRB,  and  $1.5  billion  was  added  to 
this  PE  over  the  F90-94  FYDP.  Due  to 
budget  constraints,  this  level  of  funding 
does  not  represent  a  “get  well”  profile  but 
only  a  “get  l  started"  effort  that  will  ad¬ 
dress  the  highest  priority  shortfalls. 

* 

With  this  added  funding,  this  program 
element  will^centrally  fund  test  and  evalu¬ 
ation  (T&E)*  investments  to  provide  criti¬ 
cally  needed  test  capabilities  in  the  follow¬ 
ing  functional  areas: 

o  Test  mission  command,  control, 
communications,  and  instrumentation. 

i 

o  Electronic  combat,  threat,  and 
computational  simulation. 

* 

o  Space  system  test  capabilities. 
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o  Weapons  effects  test  capabili¬ 
ties. 

o  Targets. 

o  Environmental  and  physical  test 
capabilities. 

This  central  funding  approach  is  re¬ 
sponsive  to  both  congressional  and  DoD 
desires  for  more  effective  management  of 
T&E  investments  needed  to  ensure  ade¬ 
quate  test  capabilities  for  more  realistic 
and  rigorous  evaluation  of  planned  weap¬ 
ons  acquisitions  and  to  preclude  unwar¬ 
ranted  duplication  of  test  investment. 
Moreover,  it  is  responsive  to  the  compet¬ 
ing  pressures  resulting  from  (1)  the  con¬ 
vergence  of  a  25-30  year  old  test  “plant” 
and  significant  new  weapons  technologies, 
and  (2)  limited  overall  DoD  investment  re¬ 
sources.  This  centra!  line  will  also  facili¬ 
tate  OSD’s  ability  to  ensure  cost-effective 
investment,  promote  interoperability  and 
commonality,  and  leverage  test  investment 
funding  retained  by  the  Services.  Most 
important,  this  central  program  is  not  the 
domain  of  a  single  advocate,  rather,  it  is 
managed  by  the  DoD  Test  and  Evaluation 


Committee  fTEC).  The  TEC  will  provide 
the  central  forum  for  key  representatives 
of  the  Office  of  the  Secretary  of  Defense 
(OSD),  the  Services,  and  the  Defense 
Agencies  to  establish  corporate  priorities 
through  all  phases  of  budget  formulation 
and  execution.  With  regard  to  priorities, 
the  clear  concentration  of  early  investment 
is  in  instrumentation  and  electronic  com¬ 
bat  test  capabilities,  with  continued  heavy 
concentration  on  interoperable  and  trans¬ 
portable  T&E  assets.  Priority  has  been 
given  to  increased  realism  of  electronic 
combat  testing,  with  increased  application 
of  validated  simulation  where  it  provides 
an  effective  evaluation  tool.  Major  out- 
year  investments  are  planned  in  space  sys¬ 
tem  test  capabilities,  including  instrumen¬ 
tation,  command  and  control,  and  threat 
and  payload  simulation,  to  allow  adequate 
T&E  for  the  next  generation  of  aerospace 
systems  currently  in  early  development. 

The  central  funding  provided  here, 
coupled  with  aggressive  DoD-wide  plan¬ 
ning  and  stronger  OSD-level  management 
of  investment  resources  will  allow  timely 
initial  progress  and  continued  comprehen¬ 
sive  analysis  of  total  requirements. 


A  functional  breakdown  of  this  central  program  is  provided  below: 

FY($M) 


PE  0604940D  M 

£2 

2G 

21 

22 

22 

24 

Test  Mission  C3I  39.1 

30.0 

95.2 

122.0 

146.0 

123.1 

90.4 

EC/Threat/ 

Comp  Simulations 

- 

54.7 

74.1 

139.5 

119.9 

119.0 

Space  System  Test  - 
Capabilities 

— 

3.5 

16.0 

34.0 

66.6 

77.0 

Weapons  Effects 

Test  Capabilities 

— 

10.5 

67.4 

25.3 

21.7 

3.1 

Targets 

8.4 

8.6 

7.5 

8.0 

9.3 

Environ/Physical 

Test  Capabilities 

— 

3.0 

5.8 

19.6 

9.0 

25.0 

•Total  2LI  30. 0 

•Any  differences  due  to  rounding. 

m2 

293.9 

2ZL2 

MM 

22M 
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OPERATIONAL  TEST  AND  EVALU¬ 
ATION  CAPABILITY  IMPROVEMENT 
PROGRAM 

The  Operational  Test  and  Evaluation  Ca¬ 
pability  Improvement  Program  (OT&E 
CIP)  was  reduced  to  an  appropriated  level 
of  $59  million  from  a  request  of  S93  mil¬ 
lion  for  FY88,  and  to  $59  million  from  a 
request  of  $121  million  for  FY89.  The  re¬ 
quired  restructuring  of  the  program  to  ac¬ 
commodate  reduced  funding  levels  re¬ 
sulted  in  a  realignment  of  program 
concepts  and  objectives.  The  original  con¬ 
cept  of  replicating  the  Soviet  air  defense 
elements  of  a  two  motorized  rifle  regiment 
front  satisfied  many  critical  operational 
test  and  evaluation  requirements  and  af¬ 
forded  critically  required  densities  to 
stress  US  systems  undergoing  operational 
tests.  However,  reduced  funding  has  sig¬ 
nificantly  affected  our  ability  to  bring  this 
capability  on  line  in  logical  elements. 
Consequently,  we  h we  refocused  the  pro¬ 
gram  to  concentrate  on  reducing  the  risk 
and  improving  the  fidelity  of  near-term 
OT&E  programs. 

The  OT&E  CEP  realignment  was  di¬ 
rected  at  enhancing  Service  participation 
and  implementing  three  critical  phases  to 
provide  the  DOT&E  test  information  re¬ 
quired  to  isolate  and  identify  actions  to  en¬ 
sure  adequate  operational  test  and  evalu¬ 
ation  within  reduced  funding  constraints. 
The  three  phases  are: 

o  Functional  analysis  to  deter¬ 
mine  near-term  test  resource  shortfalls 
considering  all  DoD  assets. 

o  Resource  management  to  fund 
shortfalls  efficiently. 

o  Creation  of  a  Mobile  Opera¬ 
tional  Test  Force  (MOTF)  to  augment 
Service  operational  testing  through  short¬ 
term  interoperable  procurements. 
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Prioritized  scheduled  operational  tests 
are  the  prime  driver  in  the  identification 
of  shortfalls  to  be  addressed  by  the  OT&E 
CIP.  Solutions  are  primarily  satisfied 
through  short-term  procurements.  All 
battlefield  environments  (air,  land,  sea, 
and  space)  will  be  considered,  with  mobil¬ 
ity  and  transportability  of  assets  being 
paramount. 

MOTF  equipment  will  be  utilized  and 
operated  based  on  annual  prioritized  op¬ 
erational  test  requirements.  Items  funded 
by  the  OT&E  CIP  will  always  fall  under 
the  management  purview  of  OSD. 

Service  OT&E  principals  have  been 
briefed  on  the  realigned  OT&E  CIP,  and 
all  have  formally  expressed  their  full  sup¬ 
port. 

A  draft  operating  procedure  for  the 
OT&E  CIP  has  been  prepared  and  is  un¬ 
dergoing  Service  review  and  coordination. 
A  draft  OT&E  CIP  Master  Plan  has  been 
prepared  and  is  undergoing  service  review 
and  coordination.  The  Master  Plan  con¬ 
tains  the  mechanics  of  the  program,  com¬ 
plies  with  the  guidance  provided  in  DoD 
procedure,  and  serves  as  the  program  of 
record. 

An  OT£E  CIP  tri-service  coordinating 
entity  “Slingshot,*  has  been  established. 
Its  membership  includes  representatives  of 
the  Service  staffs  and  the  Service  opera¬ 
tional  test  and  evaluation  organizations.  It 
has  been  convened  on  several  occasions  to 
coordinate  DoD-wide  operational  test  and 
evaluation  shortfalls  related  to  scheduled 
operational  tests. 

FY88  OT&E  CIP  funds  were  expended 
to  procure  items  of  threat  equipment  to 
satisfy  OT&E  shortfalls.  These  items  were 
demonstrated  in  late  summer  during  the 
Mobile  Integrated  Threat  Test  (MITT). 

The  Operational  Test  and  Evaluation 
Capability  Improvement  Program  has  ma¬ 
tured  to  the  point  where  actions  are  fully 
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coordinated  throughout  DoD  to  ensure  the 
adequacy  of  scheduled  operational  tests. 

MRTFB  MANAGEMENT  PLAN 

The  Management  Plan  for  the  Major 
Range  and  Test  Facility  Base  (MRTFB) 
proposed  by  DDDR&E(T&E)  and  DOT&E, 
details  the  Department’s  implementation 
of  the  management  concept  approved  by 
the  Deputy  Secretary  of  Defense  and  re¬ 
ported  to  Congress  in  April  1988.  Simply 
stated,  the  Test  and  Evaluation  Committee 
(TEC)  of  the  Defense  Acquisition  Board 
(DAB)  will  be  the  DoD  corporate  mecha¬ 
nism  that  will  coordinate  management  of 
not  only  the  currently  defined  Major 
Range  and  Test  Facility  Base  (MRTFB) 
but  a  new,  broader  concept  embracing  all 
elements  necessary  to  establish  a  National 
Test  Capability  Base  (NTCB).  This  NTCB 
will  encompass  a  newly  defined  MRTFB, 
as  well  as  elements  from  other  govern¬ 
ment  organizations,  academia,  and  the  pri¬ 
vate  sector  that  can  support  DoD’s  testing 
needs.  As  the  first  step  toward  attaining 
this  national  capability,  the  Department 
presented  the  management  plan  for  the 
MRTFB  subset  of  the  NTCB  to  Congress 
in  the  April  1988  report. 

The  TEC’s  approach  is  to  first  reassess 
the  structure  and  composition  of  the 
MRTFB,  while  completing  the  already  in¬ 
itiated  T&E  capabilities  data  base.  Along 
with  this,  the  TEC  is  addressing  the  estab¬ 
lishment  of  uniform  standards  for  the  en¬ 
tire  test  community  to  measure  facilities 
workload  and  utilization.  Also  being  devel¬ 
oped  and  implemented  is  a  corporate 
near-term/long-term  test  investment  mas¬ 
ter  strategy  considering  test  resources  at  a 
national  level.  This  strategy  encompasses 
planning  for  test  resources  in  a  completely 
unconstrained  financial  environment  con¬ 
sidering  only  validated  future  require¬ 
ments  reflecting  DoD  corporate  priorities 
established  by  the  IEC.  Then,  in  the  pro¬ 
gramming  and  budgeting  phase,  financial 
constraints  will  be  overlaid  on  a  resource 


plan  to  arrive  at  a  DoD  corporate  budget 
and  risk  assessment. 

First,  the  criteria  and  basis  for  DoD’s 
MRTFB  must  be  reassessed,  considering 
facilities  from  a  national  perspective. 
Those  activities  not  essential  to  DoD’s 
ability  to  test  current  and  future  weapons 
systems  should  be  dropped.  Those  activi¬ 
ties  not  presently  included,  but  key  to  fu¬ 
ture  test  capability,  must  be  added.  The 
new  MRTFB  will  provide  the  building 
block  for  eventual  definition  of  the  NTCB. 
The  TEC  will  address  test  support  re¬ 
source  requirements  from  a  national  per¬ 
spective.  Test  support  asset  compatibility 
and  interoperability  will  be  the  corner¬ 
stones  of  a  national  system  which  will  fos¬ 
ter  sharing  of  resources  in  order  to  level 
out  the  workload  peaks  and  valleys  that 
are  inherent  in  the  systems  acquisition 
testing  process. 

With  the  effort  already  under  way  to 
consolidate  and  integrate  a  data  base  that 
will  contain  information  on  DoD’s  current 
test  capability,  we  can  begin  to  add  infor¬ 
mation  on  capabilities  from  outside  the 
DoD.  Knowledge  of  those  capabilities 
available  to  DoD  from  other  sources  will 
enable  investment  strategies  to  be  devel¬ 
oped  that  focus  on  filling  national  voids. 
This  data  base  will  be  multi-tiered  and  in¬ 
clude  MRTFB  facilities,  laboratory  facili¬ 
ties,  training  facilities,  private  sector  fa¬ 
cilities,  othci  non-DoD  government 
agency  facilities,  and  all  other  facilities 
and  assets  which  might  be  suitable  in  sup- 
orting  DoD  testing.  This  data  base  will 
e  a  constantly  evolving  set  of  information 
on  the  NTCB  that  will  be  updated  regu¬ 
larly  as  new  facilities  and  capabilities 
come  into  existence. 

As  a  necessary  adjunct  to  its  under¬ 
standing  of  the  test  capabilities  resident 
within  DoD,  the  TEC  will  pursue  the 
development  of  methods  that  will  allow 
measurement  of  utilization  of  current 
capacity  to  test.  This  will  make  it  possible 
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to  know  when  efficiencies  can  be  achieved 
by  shifting  workload  and  sharing  assets. 

With  a  clearer  understanding  of  the  ca¬ 
pabilities  available  to  DoD  to  support  its 
testing  requirements  and  a  knowledge  of 
the  level  of  utilization  of  current  capabili¬ 
ties,  integrated  long-range  planning  can 
more  accurately  identify  future  needs.  Us¬ 
ing  proposed  requirements  developed  by 
each  military  Service,  a  validation  and 
prioritization  process  will  generate  DoD- 
wide  requirements  to  be  coordinated 
through  the  TEC.  Once  endorsed  by  the 
TEC,  these  requirements  will  be  convened 
into  a  master  plan  for  investments  to  en¬ 
hance  the  Department’s  ability  to  test  fu¬ 


ture  systems.  The  Services  will  be  respon¬ 
sible  for  executing  the  programs  approved 
for  the  master  plan. 


With  anticipated  tighter  constraints  on 
future  funding  levels,  programming  and 
budgeting  actions  will  require  better  coor¬ 
dination.  Through  the  TEC,  coroorate 
strategies  will  be  developed  that  make 
clear  the  priorities  within  the  master  plan 
and  the  level  of  investment  needed  each 
fiscal  year  to  execute  the  approved  strat¬ 
egy.  The  TEC  process  will  be  integrated 
with  the  Department’s  planning,  program¬ 
ming  and  budgeting  system  to  arrive  at 
T&E’s  final  position  in  the  DoD  budget. 
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ARMY  ALL  SOURCE  ANALYSIS  SYSTEM  (ASAS) 

AND 

AIR  FORCE  ENEMY  SITUATION  CORRELATION 
ELEMENT  (ENSCE) 

OF  THE 

JOINT  TACTICAL  FUSION  PROGRAM  (JTFP) 


SYSTEM  DESCRIPTION 

The  Joint  Tactical  Fusion  Program  (JTFP) 
is  a  joint  Army  and  Air  Force  program  to 
develop  an  automated  system  to  analyze, 
fuse,  and  report  in  near  real  time  high  vol¬ 
umes  of  time-sensitive  intelligence  data 
and  disseminate  the  results  to  tactical  bat¬ 
tlefield  commanders.  It  is  intended  to  pro¬ 
vide  battlefield  commanders  a  detailed 
picture  of  the  enemy  situation  and  target 
nominations  to  guide  employment  of  ma¬ 
neuver  forces  and  weapon  systems  in  the 


execution  of  the  air-land  battle.  If  the 
system  performs  as  expected,  only  min¬ 
utes  rather  than  days  will  be  required  to 
analyze  the  fuzed  information  and  dis¬ 
seminate  it  to  field  commanders. 

The  major  JTFP  components  are  the 
Army’s  All  Source  Analysis  System 
(ASAS)  and  the  Air  Force’s  Enemy  Situ¬ 
ation  Correlation  Element  (ENSCE). 
ASAS  is  the  control  node  for  the  intelli¬ 
gence  electronic  warfare  (IEW)  portion  of 
the  Army  Command  and  Control  System 
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(ACCS)  and  is  the  focal  point  for  ex¬ 
change  of  information  between  ACCS  and 
other  Services,  allied  forces,  and  intelli¬ 
gence  resources.  ENSCE  is  the  focal 
point  for  exchange  of  ii  formation  between 
the  Air  Force  Tactical  Air  Control  Center 
(TACC)/Tactieal  Air  Control  System 
(TACS)  and  other  Services,  allied  forces, 
and  theater  and  national  intelligence  re¬ 
sources.  ASAS/ENSCE  manages  tasking 
for  intelligence  collection  resources  and 
will  operate  at  levels  up  to  Top  Secret/Sen¬ 
sitive  Compartmented  Information  (TS/ 
SCI).  A  multilevel  security  information 
processing  capability  is  required. 

ASAS/ENSCE  comprises  hardware 
modules,  software  package «,  work  sta¬ 
tions,  and  mobile  tactical  shelters.  The 
hardware  modules  will  be  ir  terconnected 
by  a  local  area  network  (LAN;.  Five  types 
of  hardware  modules  include:  (1)  the  in¬ 
telligence  data  processing  (EDI)  module  to 
process  intelligence  data  in  future  system 
designs;  (2)  the  ASAS/ENSCE  interface 
module  (AIM)  to  interface  ASAS  and 
ENSCE  and  process  intelligence  data;  (3) 
the  communication  processor  and  inter¬ 
face  (CPI)  module,  which  interfaces  data 
processing  modules  with  all  other  intelli¬ 
gence  sources  through  the  area  communi¬ 
cations  network  in  future  system  designs; 
(4)  the  forward  sensor  interface  and  con¬ 
trol  (FSIC)  module,  which  relays  data 
from  ground-based  intelligence  soirees  in 
forward  areas  to  the  division  data  process¬ 
ing  modules  and  extracts  perishable  com¬ 
bat  information  from  the  message  flow  for 
brigade  commanders;  and  (5)  a  radio 
module  (the  AN/TRC-113,  which  is  al¬ 
ready  in  the  Army  inventory). 

Software  is  being  developed  with  time- 
phased  releases.  The  first  production  de¬ 
sign  release  (Release  1)  is  to  provide  the 
basic  system  and  communications  soft¬ 
ware  to  support  an  Army  tactical  opera¬ 
tions  center  (TOC)  operationally.  The  sec¬ 
ond  release  is  to  build  on  Release  1  and 
provide  operational  support  to  the  Army 


TOC,  and  the  Army  combat  electronic 
warfare  intelligence  (CEWI)  operations, 
and  the  Air  Force  Tactical  Air  Control 
Center  (TACC).  Because  of  differences  in 
the  deployment  of  hardware  for  the  Army 
and  Air  Force  which  affect  the  software 
build  process,  the  second  software  release 
is  being  designated  as  Release  2  for  the 
Army  and  Release  3  for  the  Air  Force. 
Other  releases  have  been  deferred  to  a 
preplanned  product  improvement  (P3I) 
phase. 

A  portable  ASAS/ENSCE  workstation 
(PAWS)  provides  the  user  system  inter¬ 
face.  A  tactical  simulation  (TACSIM)  will 
provide  a  capability  to  drive  the  system  for 
training  and  testing  activities. 

A  limited  capability  configuration 
(LCC),  which  comprises  AIM  modules, 
FSIC  modules,  and  PAWS,  is  now  being 
developed  for  fielding  oefore  completion 
of  full  system  development  of  the  objec¬ 
tive  system  design.  This  LCC  is  a  produc¬ 
tion  system  that  will  provide  the  hardware 
and  Release  1  of  the  ASAS  software  for 
field  testing.  Field  testing  of  the  LCC  will 
provide  feedback  for  Release  2  ASAS/ 
ENSCE  software  development. 

BACKGROUND 

In  1980,  the  House  Committee  on  Appro¬ 
priations  and  the  House  Permanent  Select 
Committee  on  Intelligence  directed  DoD  to 
consolidate  separate  Army  and  Air  Force 
efforts  to  automate  intelligence  fusion  sys¬ 
tems.  In  turn,  DoD  established  the  Joint 
Tactical  Fusion  Program  Management  Of¬ 
fice  (JTFPMO)  to  develop  a  single  auto¬ 
mated  system.  A  letter  of  instruction 
(LOO  and  joint  program  charter  were 
signed  by  the  secretaries  of  the  Air  Force 
and  Army  in  1982,  with  the  Army  as  ex¬ 
ecutive  agent.  A  Joint  Oversight  Group 
(JOG),  chaired  by  the  Vice  Chief  of  Staff 
of  the  Army,  provides  guidance  and  exer¬ 
cises  ASARC/AFSARC  authority.  In 
1984,  Congress  expressed  concerns  about 
the  cost  of  the  program  and  the  need  for 
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smaller  automated  intelligence  analysis 
systems  for  rapid  deployment  units.  Con¬ 
gressional  guidance  was  given  in  Decem¬ 
ber  1985  fo  emphasize  repackaging  and 
downsizing  of  the  hardware  to  fit  Army 
light  division  S-250  (7-foot)  shelters.  De¬ 
velopment  of  S-250  sheltered  modules 
was  conducted  in  FY86  and  FY87.  Devel¬ 
opment  of  12-foot  S-280  sheltered  mod¬ 
ules,  downsized  from  the  20-foot  Interna¬ 
tional  Sandards  Organization  (ISO) 
shelter',  was  conducted  during  FY86  and 
FY87. 

OT&E  ISSUES 

The  ASAS/ENSCE  program  is  proceeding 
without  an  approved  test  and  evaluation 
master  plan  (TEMP)  or  operational  test 
(OT)  plan.  A  draft  TEMP,  dated  April  1, 
1987,  received  Service  approval  in  January 
1988  and  has  been  received  by  OSD. 
ASAS/ENSCE  is  defined  by  the  Army  as 
an  evolving  program  and  system  that  can¬ 
not  be  fully  measured  against  require¬ 
ments  until  stable,  mature  software  has 
been  verified,  potentially  after  system  in¬ 
itial  operational  capability  (IOC)  is  de¬ 
clared.  The  Army  also  refers  to  the  hard¬ 
ware  modules  as  non-developmental  items 
fNDIs).  A  limited  capability  configuration 
(LCC),  which  comprises  AIM,  FSIC  mod¬ 
ules,  and  PAWS,  is  being  planned  for  pro¬ 
curement  and  fielding  before  completion 
of  full  system  development  and  testing. 
The  Army’s  Operational  Test  and  Evalu¬ 
ation  Agency  (OTEA)  has  concluded  from 
field  trials  on  the  AIM  and  FSIC  that  more 
time  must  be  allowed  for  developmental 
testing  *o  verify  software  maturity,  and 
that  force  development  test  and  experi¬ 
mentation  (FDT&E)  must  be  conducted  to 
refine  concepts  and  doctrine.  Operational 
and  security  requirements  will  require  se¬ 
curity  accreditation  by  the  Defense  Intelli¬ 
gence  Agency  (DIA).  The  plan  to  resolve 
these  issues  and  others  critical  to  opera¬ 
tional  effectiveness  and  suitability  has  not 
yet  been  resolved  in  the  TEMP  and  OT 
plan  approval  process. 


OT&E  ACTIVITY 

Test  and  evaluation  of  ASAS/  ENSCE  has 
included  AIM  brassboard  evaluation  at  the 
9th  Infantry  Division  (Motorized),  Fort 
Lewis,  Washington,  in  March  1985,  and  a 
PAWS  field  evaluation  at  the  2nd  Ar¬ 
mored  Division  during  June  1987.  Air 
Force  testing  of  ENSCE  in  1988  consisted 
of  software  integration  with  the  intelli¬ 
gence  correlation  element  (ICE)  and  the 
intelligence  work  station  (IWS).  Demon¬ 
stration  of  these  systems  has  been  under¬ 
way  at  Goodfellow  AFB,  Texas,  since 
March  1988.  The  all-source  portion  of 
Release  1  software  was  converted  to  IBM 
language,  and  in  July  1988  it  passed  the 
SRVT  for  future  use  on  host  computers  in 
USAFE  and  PACAF.  No  reports  have 
been  provided  to  DOT&E  on  these  activi¬ 
ties. 

OTEA  conducted  field  trials  of  AIM(6) 
and  FSIC  modules  from  November  17, 
through  December  19,  1986  at  Fort  Hood, 
Texas.  These  were  early  user  investiga¬ 
tions  of  system  operational  concepts  and 
were  designed  to  aid  development  of  op¬ 
erational  test  methodology,  instrumenta¬ 
tion,  and  resources  requirements  for  real¬ 
istic  operational  testing  of  ASAS/ENSCE. 
OTEA  issu.‘vl  a  test  report  on  these  field 
trials  in  Feb  .»ary  1987  and  followed  with 
a  June  25,  '.937  independent  operational 
assessment  (K)A)  report.  The  IOA  report 
was  forwurood  to  the  defense  committees 
of  Congress  o-,  the  Army  on  August  19, 
1987.  Our  CfiaCC  did  not  observe  the  field 
trials  because  they  were  not  approved  real¬ 
istic  operational  tests  of  the  system 
planned  for  procurement  and  fielding.  We 
will  witness  the  testing  currently  scheduled 
for  FY89. 

OSD  ietumed  the  ASAS/ENSCE 
TEMP  to  the  Army  ‘unapproved  on 
April  7,  1988.  Submission  of  a  revised 
multi-Service  approved  TEMP  was  re¬ 
quested  prior  to  initiation  of  Phase  3  of 
the  program  scheduled  for  October  1988. 
The  Army  submitted  two  supplements  to 
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the  unapproved  TEMP.  An  “Independent 
Operational  Evaluation  Concept  (IOEC) 
for  ASAS"  document  dated  June  1988  was 
submitted  July  11,  1988  and  referred  to  as 
a  Master  Evaluation  Plan  (MEP)  to  be  ap¬ 
pended  to  the  TEMP.  A  one-page  matrix 
of  technical  information  was  later  pro¬ 
vided  for  addition  to  the  TEMP. 

OT&E  ASSESSMENT 

OTEA  assessed  results  of  the  AJM(6)  and 
FISC  field  trials  in  its  IOA  report  dated 
June  25,  1987.  OTEA’s  conclusions  in¬ 
cluded  these  findings:  performance  was 
as  expected  for  this  stage  of  development; 
FISC  modules  demonstrated  significant 
capability  to  relay  information  to  nodes 
and  extract  information  from  message 
traffic;  ASAS  organizational  and  opera¬ 
tional  concepts  require  refinement;  the  re¬ 
quirement  document  needs  clarification; 
system  survivability/vulnerability  is  an  is¬ 
sue;  better  methods  and  more  time  are  re¬ 
quired  to  verify  software  maturity  and  fix 
hardware  faults;  and  test  data  collection 
and  processing  must  be  automated. 

Our  assessment  is  that  test  planning  to 
date  has  not  been  adequate  to  provide  test 
results  of  sufficient  quality  to  permit  in¬ 
formed  procurement  decisions.  Procure¬ 
ment  began  in  FY87.  Evolutionary  devel¬ 
opment,  NDI  procurement,  phased  testing, 
and  interim  fielding  strategies  of  ASAS 
still  require  adequate  OT&E  and  reports  to 


support  beyond-LRIP  decisions.  Mile¬ 
stone  IHA  has  passed  and  LRIP  is  in  pro¬ 
gress,  although  not  shown  in  the  TEMP. 
Milestone  DIB  is  not  clearly  shown  in  the 
TEMP. 

The  Army-planned  Force  Develop¬ 
mental  Test  and  Experimentation 
(FDT&E)  is  not  an  adequate  OT&E  to  sup¬ 
port  beyond-LRIP  decisions.  It  does  not 
include  quantitative  operational  results  be¬ 
ing  reported  to  either  confirm  operational 
effectiveness  and  suitability  in  the  field  or 
to  support  future  procurement  decisions  of 
either  hardware  or  software  releases.  The 
funding  and  hardware-item  (AIM,  FISC, 
PAWS,  etc.)  procurement  quantities  are 
not  clear.  Air  Force  participation  is  not 
clear.  Validated  threat,  quantifiable  mis¬ 
sion  effectiveness  goals  and  thresholds, 
and  simulator  validations  are  still  not  ad¬ 
dressed.  Procurement  is  continuing  on  this 
major  DoD  program  without  approval  of 
adequate  OT&E  to  support  the  procure¬ 
ment  and  program  milestone  decisions. 

SUMMARY 

The  unapproved  TEMP  is  almost  two 
years  old.  During  the  last  year  it  was  not 
revised  or  resubmitted  as  a  multi-Service 
approved  TEMP  as  called  for  by  OSD.  A 
TEMP  and  an  OT  plan  approved  by  OSD 
are  required  before  this  office  can  approve 
testing  adequate  to  support  procurement 
decisions. 
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ENHANCED  POSITION  LOCATION  REPORTING  SYSTEM  (EPLRS) 


SYSTEM  DESCRIPTION 

The  Position  Location  Reporting  System 
(PLRS)  is  a  computer-based  system  which 
is  intended  to  provide  secure  and  jam-re¬ 
sistant  navigation,  position  location, 
identification,  and  automatic  reporting  to 
the  Net  Control  Station  (NCS)  for  subse¬ 
quent  recall  by  authorized  PLRS  equipped 
units.  The  Enhanced  PLRS  (EPLRS)  sys¬ 
tem  permits  increased  (up  to  1200— bit— 
per-second)  direct  data  communications 
between  EPLRS  equipped  units  after  the 
NCS  establishes  the  communications  path 
between  the  units.  The  NCS  allocates  the 
EPLRS  communications  resource  based 
upon  predetermined  need-line  require¬ 
ments.  Communications  paths  which  ex¬ 
perience  poor  communications  reliability 


are  automatically  reported  to  the  NCS. 
The  NCS  automatically  searches  for  and 
assigns  alternate  routes  to  improve  con¬ 
nectivity.  EPLRS  consists  of  three  basic 
components:  the  Net  Control  Station 

(NCS),  which  controls  and  manages  the 
network;  three  or  more  EPLRS  Grid  Refer¬ 
ence  Units  (EGRUs),  which  are  located  at 
known  reference  points  and  establish 
ground  reference  for  EPLRS  relative  navi¬ 
gation  capability;  and  a  number  of  EPLRS 
User  Units  (EPUUs),  which  can  be  located 
on  vehicles,  aircraft,  or  individual  sol¬ 
diers.  The  EPUUs  provide  data  interface 
ports  for  sending  and  receiving  data. 
Each  user  unit  can  serve  as  a  communica¬ 
tions  relay.  The  distribution  of  the  EPUUs 
on  the  battlefield  and  the  ability  of  each 
EPUU  to  relay  information  is  expected  to 
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provide  connectivity  between  the  forward 
deployed  units  and  the  NCS. 

In  1972  the  Marine  Corps  began  devel¬ 
opment  of  the  PLRS.  The  Army  joined 
the  program  in  1973  and  established  the 
joint  program  office  at  Port  Monmouth, 
New  Jersey.  Following  a  competitive  de¬ 
velopment,  Hughes  Aircraft  Company  was 
selected  to  complete  development  in  1976. 
A  combined  DT/OT  was  conducted  in 
1981  and  1982.  In  1983  a  joint  production 
contract  was  awarded.  In  1982,  prior  to 
the  contract  award,  the  Army  Systems  Ac¬ 
quisition  Review  council  (ASARC)  ap¬ 
proved  the  concurrent  five-phased  devel¬ 
opment  of  the  PLRS/JTIDS  Hybrid  (PJH). 
PJH  was  intended  to  respond  to  Army 
Data  Distribution  System  (ADDS)  require¬ 
ments.  EPLRS  has  evolved  from  the  PJH 
development,  and  a  portion  of  the  Army 
PLRS  equipment  has  been  converted  to 
EPLRS.  In  1987  the  Army  decided  to  en¬ 
ter  low-rate  initial  production  (LRIP)  of 
EPLRS  by  converting  the  PLRS  equipment 
procured  in  1983.  This  decision  was  re¬ 
confirmed  by  the  Army  in  1988,  and  the 
first  two  phases  of  the  EPLRS  LRIP  were 
awarded  in  February  and  June  1988.  The 
decision  to  convert  the  remaining  PLRS 
units  to  EPLRS  under  the  LRIP  program  is 
scheduled  for  1989  following  the  comple¬ 
tion  of  EPLRS  technical  testing  (TT)  on 
the  engineering  development  models 
(EDMs).  Technical  testing  began  in  May 
1988  and  was  completed  in  September 
1988.  However,  problems  identified  dur¬ 
ing  technical  testing  are  expected  to  ex¬ 
tend  the  test  into  CY  1989.  The  Technical 
Test  and  an  Army  Operational  Test  and 
Evaluation  Agency  (OTEA)  Operational 
Assessment  (OA)  are  to  be  provided  to 
DOT&E  prior  to  the  final  LRIP  decision. 

OT&E  ISSUES 

The  Army  plans  to  make  a  sole-source 
production  decision  following  an  initial  op¬ 
erational  test  and  evaluation  (IOT&E)  cur¬ 
rently  scheduled  for  Apri  1-May  1990  at 


Fort  Hood,  Texas.  DOT&E  considers  this 
milestone  to  constitute  a  Beyond  LRIP 
(BLRIP)  decision  point. 

Operational  test  issues  include  the  op¬ 
erational  effectiveness  and  suitability  of 
EPLRS  to  support  mobile  operations  under 
full  load  conditions  (460  EPUUs)  in  the 
expected  electronic  warfare  (EW)  environ¬ 
ment.  Previous  testing  of  the  PLRS  sys¬ 
tem  indicated  performance  degradations 
under  EW  conditions  and  under  less  than 
full  load  (360  EPUUs)  conditions.  Critical 
performance  measures  are  considered  to 
be:  adequacy  and  accuracy  of  the  position 
location  information;  adequacy  of  the 
EPLRS  data  communication  capacity  to 
support  Army  Data  Distribution  System 
(ADDS)  requirements;  adequacy  of  the 
EPLRS  communications  connectivity;  the 
ability  of  EPLRS  to  support  time  sensitive 
requirements  for  data  communications  in 
support  of  highly  mobile  operations  in  an 
EW  environment;  and  the  ability  of  an 
NCS  to  accept  and  manage  an  adjacent 
brigade  EPLRS  network  during  a  reloca¬ 
tion  or  disruption  of  the  adjacent  brigade’s 
NCS. 

OT&E  ASSESSMENT 

No  operational  testing  has  been  performed 
on  EPLRS.  PLRS  operational  testing  in 
1982  and  in  1988  both  revealed  system  de¬ 
ficiencies  which,  unless  corrected,  are  ex¬ 
pected  to  adversely  affect  EPLRS  perform¬ 
ance.  Technical  testing  of  EPLRS  has 
identified  additional  problems,  to  include: 
(1)  a  less  than  full  ability  to  transmit  and 
receive  TACFIRE  data;  (2)  slow  activation 
of  communications  links  in  support  of  es¬ 
tablished  need-line  requirements;  (3)  slow 
reconstruction  of  the  EPLRS  network  fol¬ 
lowing  a  disruption;  and  (4)  slow  data 
transfer  between  users.  The  first  three 
problems  have  been  isolated  and  correc¬ 
tive  actions  have  been  identified.  The 
fourth  problem  has  not  been  isolated  and 
is  expected  to  cause  additional  delays  in 
the  completion  of  technical  testing.  Reso¬ 
lution  of  the  above  problems  are  planned 
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to  be  demonstrated  during  Phase  2  of  the 
Technical  Test. 

SUMMARY 

The  EPLRS  system  represents  a  significant 
change  from  the  PLRS  design  and  has  not 


been  operationally  tested.  An  OTEA  op¬ 
erational  assessment  of  the  technical  test¬ 
ing  is  required  prior  to  a  decision  to  com¬ 
plete  the  conversion  of  the  remaining 
Army  PLRS  equipment  to  EPLRS.  A  full 
operational  test  »s  required  prior  to  pro¬ 
ceeding  beyond  LRIP. 
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FORWARD  AREA  AIR  DEFENSE  (FAAD) 


SYSTEM  DESCRIPTION 

The  air  threat  to  forward  area  US  combat 
elements  consists  of  enemy  helicopters 
and  fixed-wing  aircraft.  Previous  testing 
with  the  DIVAD  (Sgt.  York)  system  has 
made  clear  that  the  threat,  particularly 
that  from  hovering  helicopters  using 
standoff  missile  systems,  will  be  signifi¬ 
cant  and  difficult  to  counter.  To  accom¬ 
plish  this,  the  Army  Forward  Area  Air  De¬ 
fense  (FAAD)  system  is  being  developed. 
FAAD  is  an  aggregation  of  five  elements: 
a  line-of-sight  forward  heavy  system 
(LOS-F-H);  a  non-line-of-sight  system 
(NLOS);  the  Pedestal  Mounted  Stinger 
(PMS);  a  command,  control,  and  intelli¬ 
gence  system  (C2I);  and  a  combined  arms 
initiative  (CAI)  to  improve  the  counter-air 
capability  of  mechanized  forces  (M-l  and 


Bradley)  and  to  develop  an  air-to-air  ca¬ 
pability. 

In  July  1987  the  Army  completed  test¬ 
ing  for  the  selection  of  the  system  to  fill 
the  PMS  role,  the  Avenger.  In  November 
1988  the  Army  completed  testing  for  the 
LOS-F-H  role,  the  Air  Defense  Anti- 
Tank  System  (ADATS).  Neither  system 
will  enter  full-scale  production  until  suc¬ 
cessful  conclusion  of  the  Initial  Opera¬ 
tional  Test  and  Evaluation  (IOT&E)  sched¬ 
uled  for  mid  to  late  1989.  A  series  of 
technical  tests  under  operational  condi¬ 
tions  are  now  being  conducted  at  White 
Sands  Missile  Range,  New  Mexico,  to  as¬ 
sess  the  ability  of  the  single  candidate  sen¬ 
sor  to  meet  the  requirements  for  the 
FAAD  C2I  ground  based  sensor.  In  Octo¬ 
ber  1988,  the  NLOS  system  (the  Fiber  Op- 
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tic  Guided  Missile,  or  FOG-M)  entered 
into  an  initial  operational  evaluation  on  a 
prototype  system  at  Redstone  Arsenal, 
Alabama,  with  subsequent  testing  sched¬ 
uled  for  White  Sands  Missile  Range,  New 
Mexico  in  1989. 
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BACKGROUND 


A  system  has  not  been  selected  for  the 
FAAD  C2I  ground  based  sensor  (GBS). 
However,  it  is  likely  that  the  system  will 
be  a  highly  mobile,  wheel-mounted  radar 
with  minimum  operator  interface.  Its 
function  will  be  to  detect  and  cue  hostile 
targets  for  the  FAAD  weapon  systems  and 
provide  airspace  coverage  over  and  be¬ 
yond  the  division’s  airspace,  enhancing 
friendly  aircraft  protection.  The  radars 
will  be  netted  through  a  command  and 
control  network  and  will  share  information 
among  each  other  within  the  division.  The 
current  plans  call  for  six  radars  per  divi¬ 
sion. 


The  GBS  is  the  first  piece  of  the  FAAD 
C2I  system  to  be  tested.  It  is  necessary  to 
determine  what  system  will  fill  this  role  in 
order  to  provide  the  hardware  component 
to  the  contractor  responsible  for  develop¬ 
ing  the  air  defense  software  (Build  I)  for 
the  FAAD  C2I  system.  Selection  of  the 
system  was  structured  as  a  non-develop- 
mental  item  (NDI)  solution,  and  a  request 
for  proposal  was  released  in  April  1988. 
Only  one  proposal  was  received  by  the 
Army.  However,  the  test,  originally  a  com¬ 
petitive  candidate  evaluation,  remained  as 
scheduled  and  is  currently  underway  at 
White  Sands  Missile  Range,  New  Mexico. 
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OT&E  ISSUES 

The  test  is  a  combined  technical  and  op¬ 
erational  test,  with  emphasis  on  technical 
testing.  The  objectives  are  to  test  the  sen¬ 
sor  system  equitably  under  simulated  con¬ 
ditions,  using  approved  threat  flight  pro¬ 
files  to  collect  and  assess  field  data  on 
which  to  base  an  independent  e  valuation, 
and  to  provide  data  to  the  Proposal  Evalu¬ 
ation  learn.  Specifically,  the  Army  has 
stated  that  the  test  program  is  intended  to 
characterize  the  maturity  and  capabilities 
of  the  GBS  sensor  system  with  respect  to 
its  technical,  operational,  and  suitability 
requirements  in  the  following  areas: 

o  System  mission  performance; 

o  Survivability  and  vulnerability; 
and 

o  Reliability,  availability,  and 
maintainability  (RAM). 

The  DOT&E  has  approved  this  test 
plan  contingent  upon  the  implementation 
of  a  number  of  modifications  to  make  it 
more  operationally  realistic  and  fair. 
Among  the  required  changes  were  the  in¬ 
clusion  of  the  currently  fielded  FAAR  ra¬ 
dar  to  serve  as  a  baseline  for  comparison, 
addition  of  ground  vehicles  in  the  radar 
field  of  view,  mobility  testing,  adjustment 
to  threat  profiles,  and  the  switching  of  the 
candidate  system  and  the  FA/AR  baseline 


system  between  radar  sites.  Of  particular 
interest  was  the  requirement  for  a  follow- 
on  test  to  determine  adequateiy  the  effec¬ 
tiveness  of  the  GBS  to  cue  the  FAAD 
weapon  systems  in  an  accurate  and  timely 
manner.  This  test  must  include  a  com¬ 
parison  with  a  modem  2D  radar,  versus 
the  3D  candidate  system,  and  must  be 
completed  early  enough  to  provide  data 
for  the  decision  to  support  procurement  of 
the  first  low-rate  production  systems  (11 
total). 

OT&E  ACTIVITY 

No  testing  on  this  system  has  been  con¬ 
ducted  previously.  The  first  test,  de¬ 
scribed  above,  is  currently  underway  at 
White  Sands  Missile  Range,  New  Mexico. 
However,  no  substantive  data  has  been 
made  available  in  this  early  part  of  the 
program. 

SUMMARY 

The  GBS  is  a  key  first  element  of  the 
FAAD  C2I  program.  This  test,  the  first  of 
several  the  GBS  must  undergo  prior  to 
full-scale  production,  will  provide  valu¬ 
able  data  on  the  operational  effectiveness 
and  suitability  of  the  sensor.  However,  the 
overall  effectiveness  will  not  be  known  un¬ 
til  the  total  FAAD  C2I  architecture  (hard¬ 
ware  and  software)  is  available  for  testing. 
This  is  currently  scheduled  for  FY90. 
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LINE-OF-SIGHT-FORWARD-HEAVY  (LOS-F-H) 
AIR  DEFENSE  ANTI-TANK  SYSTEM  (ADATS) 


SYSTEM  DESCRIPTION 

The  Air  Defense  Anti-Tank  System 
(ADATS)  is  a  highly  mobile  and  transport¬ 
able  air  defense  weapon  system  that 
mounts  eight  laser-beam  riding  missiles 
on  a  Bradley  Fighting  Vehicle  (M3A2) 
chassis.  The  system  also  includes  a 
search  radar,  television  optics,  a  forward 
looking  infrared  receiver  (FLIR),  and  a  la¬ 
ser  range-finder.  An  ADATS  crew  con¬ 
sists  of  the  fire-unit  commander,  the  gun¬ 
ner,  and  the  driver.  ADATS  is  an 
international  system;  its  major  compo¬ 
nents  are  supplied  by  contractors  from  the 
United  States,  Canada,  Switzerland,  and 
Italy. 


BACKGROUND 

ADATS  is  expected  to  provide  low-alti¬ 
tude  air  defense  to  the  forward  division 
area,  especially  the  forward  maneuvering 
units  such  as  Ml  Abrams  tanks  and 
Bradley  Fighting  Vehicles.  In  addition, 
ADATS  must  maneuver,  fight,  and  survive 
while  providing  support  to  the  forward 
maneuvering  units.  Standoff  hovering 
helicopters  as  well  as  attacking  fixed  wing 
aircraft  will  comprise  the  primary  threat 
to  ADATS,  which  will  be  deployed  in 
heavy  divisions,  separate  heavy  brigades 
(armored  and  mechanized  infantry),  and 
armored  cavalry  regiments. 
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Following  the  Non-Developmental 
Item  Candidate  Evaluation  Test  in  Novem¬ 
ber  1987,  the  Army  selected  ADATS  as 
the  most  effective  system.  However,  since 
the  proposed  system  will  be  changed 
somewhat  from  the  prototype  presented 
for  testing,  only  four  systems  were  pro¬ 
cured  to  support  further  testing. 

OT&E  ACTIVITY 

No  operational  testing  was  conducted  on 
this  system  in  1988.  However,  this  office 
was  directly  responsible  for  influencing  a 
number  of  key  events  significantly  affect¬ 
ing  the  progress  of  this  program. 

Issues  and  Criteria.  This  office  approved 
the  Army’s  critical  operational  issues  and 
criteria  and  notified  the  Congress  of  the 
same  in  September  1988.  This  certifica¬ 
tion  was  required  by  Congress  before  the 
Army  could  obligate  FY88  funds  ear¬ 
marked  for  advance  procurement.  As  a 
result  of  our  negotiations  with  the  Army, 
the  criteria  were  expanded  to  provide  for  a 
more  operationally  realistic  platoon  figure 
in  addition  to  individual  fire  unit  perform¬ 
ance  figures.  These  figures  were  for 
evaluation  planning  purposes  only  and  will 
be  refined  prior  to  initial  operational  test 
and  evaluation. 

Smoke  Week  Testing.  This  office  moni¬ 
tored  the  participation  of  ADATS  in  the 
Army’s  annual  Smoke  Week  testing  during 
September  1988.  Data  to  determine  the 
ability  of  the  system  to  provide  command 
guidance  to  the  missile  through  obscura¬ 
tion  will  not  be  available  for  analysis  until 
January  1989. 

Force  Development  Test  and  Experimen¬ 
tation  (FDTE I).  Force  Development  Test 
and  Experimentation  I  (FDTE  I)  was  con¬ 
ducted  in  June  and  July  1988,  at  Fort 
Bliss,  Texas.  The  purpose  of  FDTE  I  was 
to  facilitate  the  development  of  training, 
tactics,  techniques,  procedures,  and  organ¬ 
izational  concepts  for  the  LOS-F-H 


weapon  system.  In  addition,  limited  logis¬ 
tical  information  on  equipment  failures, 
time  to  repair,  and  operator  preventive 
maintenance  checks  and  services  was  col¬ 
lected.  The  issues  for  the  FDTE  I  were: 

o  Do  the  individual  and  collective 
tasks,  battle  drills,  and  tactics,  techniques, 
and  procedures  prepare  LOS-F-H  crew¬ 
men  to  optimize  the  system’s  perform¬ 
ance? 

o  Are  the  correct  numbers  and 
types  of  personnel  and  equipment  pro¬ 
vided  at  the  squad  level  to  support  the 
LOS-F-H  mission? 

FDTE  I  was  conducted  using  the 
ADATS  selected  by  the  Army  as  a  result 
of  candidate  evaluation  (July-November 
1987).  The  ADATS  system  was  mounted 
on  a  Ml  13  chassis.  Soldiers  were  used  as 
operators,  but  all  maintenance  above  op¬ 
erator  level  was  performed  by  the  contrac¬ 
tor.  The  operational  environment  con¬ 
sisted  of  the  approved  air  threat  against  a 
single  fire  unit,  simulated  nuclear,  biologi¬ 
cal,  chemical  threat,  flares,  chaff,  elec¬ 
tronic  jamming,  and  smoke.  All  areas  of 
MANPRINT  were  investigated.  A  test- 
fix-test  philosophy  was  applied  to  the 
training,  tactics,  organization,  logistics, 
and  threat  baseline  package. 

FDTE  I  identified  needed  changes  to 
the  training,  tactics,  and  logistical  consid¬ 
erations  necessary  to  increase  the  squad’s 
fire  unit  performance.  It  also  provided  the 
user  a  foundation  for  the  FDTE  II  and  in¬ 
itial  operational  test  and  evaluation  sched¬ 
uled  for  1989. 

SUMMARY 

The  majority  of  operational  testing  for 
ADATS  is  scheduled  for  1989.  However, 
this  office  has  monitored  and  will  continue 
to  monitor  the  overall  evaluation  of  the 
operational  effectiveness  and  suitability  of 
this  system.  In  addition  to  the  activities 
mentioned  above,  DOT&E  will  report  to 
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Congress  on  the  adequacy  of  qualification 
and  operational  test  plans  prior  to  the  Ar¬ 
my's  obligation  of  funds  appropriated  for 
FY89.  we  will  monitor  contractor  and 
government  missile  firings  and  govern¬ 
ment  technical  testing  and  prepare  an 
Early  Operational  Assessment  after  the 
conduct  of  the  Field  Training  Exercise 
scheduled  for  April  1989. 
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The  NLOS  Fiber  Optic  Guided  Missile,  or 
FOG-M,  tactical  system  will  be  available 
in  two  variants,  light  and  heavy.  Each 
type  consists  of  a  launcher,  missiles  (6  on 
light,  24  on  heavy),  gunner’s  console,  and 
land  navigator,  and  will  be  placed  on  a 
suitable  vehicle  (light  on  wheels,  heavy  on 
tracks).  The  FOG-M  system  is  designed 
to  engage  stationary  or  moving  targets 
masked  by  terrain  or  vegetation  at  ex¬ 
tended  ranges.  FOG-M  system  missiles 
are  launched  and  flown  by  the  crew  using 
an  on-board  TV  camera  or  imaging  infra¬ 
red  (HR)  sensor  linked  to  the  gunner’s 
console  via  a  fiber  optic  cable.  FOG-M 
fire  units  are  organic  to  batteries  of  the 
divisional  area  FAAD  battalion  and  will  be 
deployed  in  light  and  heavy  divisions  as 


BACKGROUND 


The  FOG-M  system  was  selected  for  de¬ 
velopment  as  the  NLOS  element  of 
FAAD.  The  NLOS  element  has  the  re¬ 
sponsibility  of  engaging  slow  moving  heli¬ 
copter  and  armor  targets  before  they  have 
reached  ranges  where  they  can  attack 
friendly  assets.  These  targets  can  be  hid¬ 
den  from  view  from  friendly  lines.  A 
semitactical  prototype  system  has  been  de¬ 
veloped  and  designated  as  the  initial  op¬ 
erational  evaluation  (IOE)  system.  At  one 
time,  this  prototype  was  to  have  been  con¬ 
verted  into  an  initial  system  through  a  fur¬ 
ther  maturation  process  for  limited 
production  in  small  quantities,  while  a 


SYSTEM  DESCRIPTION 


well  as  in  FAAD  elements  of  separate  bri¬ 
gades  and  armored  cavalry  regiments. 


NON-LINE-OF  SIGHT 
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more  capable  objective  system  was  being 
developed.  Congressional  direction  now 
dictates  that  the  IOE  system  is  not  to  be 
produced  and  that  the  more  capable  Block 
I  objective  system  will  undergo  accelerated 
development  and  fielding.  The  IOE  sys¬ 
tem  is  to  be  tested  for  lessons  learned  to¬ 
ward  a  better  objective  system  and  to 
evaluate  the  performance  and  human  in¬ 
teroperability  of  the  existing  prototype. 

OT&E  ISSUES 

Fourteen  FOG-M  firing  tests  were  con¬ 
ducted  at  Redstone  Arsenal,  Alabama,  be¬ 
tween  February  1984  and  May  1987. 
These  tests  demonstrated  the  early  proto¬ 
type  missile’s  capability  to  engage  hover¬ 
ing  and  maneuvering  helicopters  as  well 
as  moving  and  stationary  tanks.  The  in¬ 
itial  operational  evaluation  of  this  semitac- 
tical  prototype  system  will  be  the  first  test 
to  address  some  operational  aspects  of  the 
system.  Specifically,  the  Army  has  identi¬ 
fied  the  following  objectives  for  this  test: 

o  To  collect  limited  operational 
and  technical  data  on  the  semitactical  pro¬ 
totype  IOE  system  to  assess  system  per- 
foimance  and  interoperability  with  the  C2I 
system. 

o  To  assess  the  impact  of  the  C2I 
system  on  mission  performance. 

o  To  evaluate  the  soldier’s  ability 
to  detect,  identify,  track,  and  engage  tar¬ 
gets  in  both  the  benign  and  dirty  battle¬ 
field,  using  the  semitactical  prototype  IOE 
system. 


o  To  gather  information  about  the 
operation  of  the  semitactical  prototype 
IOE  system  in  Mission  Oriented  Protective 
Posture  gear  which  can  be  used  to  im¬ 
prove  the  design  of  the  Block  I  objective 
system. 

After  recommendations  to  the  Army 
for  the  improvement  of  the  operational  re¬ 
alism  of  die  test  were  implemented,  the 
DOT&E  approved  the  plan  for  this  test.  It 
is  a  combined  operational  and  technical 
test  conducted  by  the  Army  Test  and 
Evaluation  Command  in  conjunction  with 
the  Army  Air  Defense  Artillery  Board.  It 
will  be  conducted  at  both  Redstone  Arse¬ 
nal,  Alabama,  and  White  Sands  Missile 
Range,  New  Mexico. 

OT&E  ACTIVITY 

The  IOE  is  currently  underway  at 
Redstone  Arsenal,  Alabama.  However,  it 
is  too  early  in  the  process  to  provide  any 
definitive  test  results.  This  is  the  first  of 
several  test  and  evaluation  opportunities 
prior  to  the  proposed  low-rate  production 
buy  currently  planned  for  FY90. 

SUMMARY 

The  IOE  is  not  a  test  of  the  objective  sys¬ 
tem.  However,  the  test  will  provide  les¬ 
sons  learned  to  permit  development  of  a 
better  Block  I  objective  system.  This  is  the 
first  of  several  tests  which  will  eventually 
determine  the  operational  effectiveness 
and  suitability  of  this  system  prior  to  full- 
scale  production. 
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SYSTEM  DESCRIPTION 

The  Pedestal  Mounted  Stinger  (PMS)  con¬ 
sists  of  a  High  Mobility  Multipurpose 
Wheeled  Vehicle  (HMMWV),  radio,  iden¬ 
tification  friend  or  foe  (IFF)  system,  a 
standard  vehicle-mounted  launcher,  and  a 
weapons  platform  pedestal  consisting  of  a 
fire-prediction  system  and  operator  sta¬ 
tion.  The  system  includes  eight  Stinger 
missiles  and  a  50-caliber  machine  gun. 
The  Stingers  may  be  individually  removed, 
fitted  with  a  gripstock,  and  fired  as  a  man- 
portable  air  defense  system  (MANPADS) 
weapon. 

BACKGROUND 

The  PMS  concept  was  believed  to  have  the 
potential  to  (1)  extend  the  capability  of  the 


Stinger  missile  to  night  and  adverse 
weather  operations,  (2)  decrease  out-of¬ 
range  engagements,  (3)  provide  a  self¬ 
protection  capability,  (4)  have  a  shoot-on- 
the-move  capability  and  (5)  have  the 
capability  to  engage  targets  in  rapid  suc¬ 
cession.  During  the  acquisition/tracking 
and  live-fire  phases  of  testing  these  poten¬ 
tial  capabilities  were  tested  and  compared 
to  MANPADS.  Following  the  Non-Devel- 
opmental  Item  Candidate  Evaluation 
(NDICE)  Test  in  July  1987,  the  Army  se¬ 
lected  the  Avenger  as  the  most  effective 
PMS  system.  Further  operational  tests  are 
planned  for  mid-1989  to  address  the  op¬ 
erational  effectiveness  and  suitability  of 
the  system  for  use  on  the  battlefield  prior 
to  a  full-scale  production  decision. 


PEDESTAL  MOUNTED 
STINGER  (PMS) 
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OT&E  ACTIVITY 

No  operational  testing  was  conducted  on 
this  system  in  1988.  However,  this  office 
monitored  the  Force  Development  Test 
and  Experimentation  I  (FDT&E  I)  con¬ 
ducted  by  the  Air  Defense  School  June- 
July  1988.  The  purpose  of  FDT&E  I  was  to 
facilitate  the  development  of  training,  tac¬ 
tics,  techniques,  procedures,  and  organiza¬ 
tional  concepts.  It  also  provided  limited 
logistical  information  concerning  such 
matters  as  equipment  failure,  time  to  re¬ 
pair,  and  operator  preventative  mainte¬ 
nance  checks  and  services.  The  issues  for 
FDT&E  I  were: 

o  Do  the  individual  and  collective 
tasks,  battle  drills  and  tactics,  techniques, 
and  procedures  prepare  PMS  crew  mem¬ 
bers  to  optimize  system  performance? 

o  Are  the  correct  numbers  and 
types  of  personnel  and  equipment  pro¬ 


vided  at  the  squad  level  to  support  the 
PMS  mission? 

OT&E  ASSESSMENT 

The  FDT&E  I  was  conducted  using  one 
prototype  system  (the  NDICE  system), 
with  nine  operators.  The  operational  envi¬ 
ronment  consisted  of  the  approved  air 
threat  against  a  single  fire  unit,  simulated 
NBC,  flares,  chaff  and  smoke.  MAN- 
PRINT  was  also  investigated.  The  test- 
fix-test  philosophy  was  applied  to  the 
training,  tactics,  organization,  logistics, 
and  threat  baseline  packages. 

SUMMARY 

The  FDT&E  I  identified  needed  changes  to 
the  training,  tactics,  and  logistical  consid¬ 
erations  necessary  to  increase  the  squad’s 
fire  unit  performance.  It  also  provided  the 
user  a  foundation  for  the  FDT&E  II  and 
initial  operational  test  and  evaluation 
scheduled  for  1989. 
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The  HMMWV  is  a  wheeled  vehicle  using  a 
common  chassis  to  accommodate  pay¬ 
loads  in  the  1/4  ton  to  1  1/4-ton  range  in 
combat,  combat  support,  and  combat  serv¬ 
ice  support  roles.  It  is  a  full-time  four- 
wheel  drive  vehicle  incorporating  a  V-8, 
6.2  liter  diesel  engine,  a  3-speed  auto¬ 
matic  transmission,  a  2-speed  transfer 
case,  power  steering,  and  independent 
front  and  rear  suspension.  The  initial 
HMMWV  Group  I  variant  included  vehi¬ 
cles  with  a  gross  vehicle  weight  (GVW)  of 
7,700-8,200  pounds.  Group  II  variants 
have  a  GVW  of  8,660-9,100  pounds.  The 
Army  is  also  evaluating  a  9,400  pound 
variant  (Ml 069)  to  be  used  as  a  prime 


mover  for  the  towed  lightweight  Ml  19 
howitzer  and  the  M167A1  towed  Vulcan 
air  defense  weapon  system. 

In  the  combat  role,  the  HMMWV  is 
used  for  anti-armor,  reconnaissance,  rear 
area  combat  operations,  base  defense  and 
close  air  support  control.  In  the  combat 
support  role,  the  shelter  carrier  and  cargo 
versions  of  the  HMMWV  are  used  in  com¬ 
mand,  control,  communications,  and  intel¬ 
ligence  (C3I);  fire  support  team;  target  ac- 

3uisition;  naval  gunfire  control;  air 
efense;  battlefield  obscuration;  and  nu¬ 
clear,  biological,  and  chemical  (NBC)  re¬ 
connaissance  operations.  In  the  combat 
service  support  role,  the  HMMWV  cargo 
and  ambulance  versions  support  logistics, 
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cargo  carrier,  and  medical  evacuation  op¬ 
erations. 

BACKGROUND 

The  HMMWV  program  is  an  outgrowth  of 
three  previous  programs:  the  combat  sup¬ 
port  vehicle  program  in  the  late  1960s, 
which  was  to  serve  as  a  wheeled  vehicle 
carrier  for  the  TOW  weapon  system;  the 
3/4  to  1  1 /4-ton  Expanded  Mobility  Tacti¬ 
cal  Truck  (EMIT)  program,  which  was  to 
develop  a  replacement  for  the  Gama  Goat; 
and  the  High  Mobility  Weapons  Carrier 
(HMWC)  program,  which  was  intended  to 
develop  a  weapons  platform  for  the  TOW 
and  other  armament  systems. 

In  July  1980,  the  joint  mission  element 
need  statement  (JMENS)  for  the  HMMWV 
was  approved.  The  HMMWV  is  pro¬ 
grammed  as  a  replacement  for  selected 
M151  jeeps,  M274  mules,  M561  Gama 
Goats,  and  M792  1  1/4-ton  ambulances. 
The  total  acquisition  cycle  for  the 
HMMWV  has  been  expedited  to  replace 
these  aging  vehicles.  A  concurrent  devel¬ 
opmental  test  II  and  operational  test  II  (DT 
11  and  OT  II)  was  concluded  in  September 
1982.  Follow-on  evaluation  for  the  initial 
HMMWV  variants  (Group  I  vehicles — 
HMMWV-TOW  and  HMMWV-Utility) 
was  completed  in  December  1984.  The 
first  unit  was  equipped  in  September 
1985.  The  Group  II  variants  (HMMWV 
S-250  shelter  carrier  (Ml  037)),  4— latter 
ambulance  (M997),  and  2-litter  ambu¬ 
lance  (M996)  are  to  replace  the  M561 
Gama  Goat  shelter  carrier,  the  M718  front 
line  ambulance,  and  M792  Gama  Goat 
Ambulance. 

Basic  testing  of  the  Group  II  variants 
included  an  operational  assessment  (OA) 
conducted  by  USAOTEA  at  Fort  Lewis 
and  Yakima  Firing  Range,  Washington, 
from  July  through  October  1987,  and  a 
Marine  Corps  amphibious  compatibility 
test  conducted  at  the  Naval  Amphibious 


Base,  Coronado,  California,  from  October 
1987  to  March  1988.  DOT&E  approved 
the  Test  Design  Plan  for  the  OA  in  Janu¬ 
ary  1987.  OSD  approved  the  HMMWV 
Ml  069  Test  and  Evaluation  Master  Plan  in 
November  1987. 


In  our  last  Annual  Report  we  stated 
that  we  would  provide  a  DOT&E  assess¬ 
ment  of  the  HMMWV  Group  II  variants  to 
Congress  prior  to  the  upcoming  produc¬ 
tion  decision.  Earlier,  in  our  approval  of 
the  Test  Design  Plan,  we  stated  that  a  pro¬ 
duction  decision  could  not  be  made  until 
OT  results  were  considered  and  a 
USAOTEA  assessment  was  made.  In  both 
cases  we  understood  that  a  Group  n  pro¬ 
duction  decision  was  pending.  This  under¬ 
standing  came  into  question  when  we 
learned  that  the  Commander,  US  Army 
Materiel  Command  had  approved  condi¬ 
tional  release  of  over  3000  vehicles.  The 
Director  requested  and,  on  July  25,  1988, 
received  an  Army  briefing  on  the  pro¬ 
gram.  We  discussed  the  specifics  of  the 
HMMWV  as  well  as  the  broader  category 
of  programs  in  which  an  acquisition  deci¬ 
sion  is  made  within  the  Army  when  the 
program  is  on  the  DOT&E  oversight  list. 
For  HMMWV,  the  production  decision 
and  contract  award  had  been  made  in 
early  1983,  prior  to  passage  of  10  USC 
138.  The  decision  being  made  was  there¬ 
fore  considered  by  the  Army  to  be  for 
fielding,  not  production.  It  was  agreed 
that  the  program  needed  to  resolve  the  re¬ 
maining  concerns  on  the  Group  n  vehicles 
and  implement  necessary  corrective  ac¬ 
tions  to  include  applying  the  necessary 
changes  to  vehicles  already  produced.  It 
was  agreed  that  USAOTEA  would  provide 
DOT&E  a  status  report  on  the  four  spe¬ 
cific  concerns  in  mid-September  and  a  fi¬ 
nal  Independent  Evaluation  Report  in  No¬ 
vember  1988.  For  the  broader  category, 
DOT&E  agreed  to  provide  an  explanatory 
memorandum,  suitable  for  broad  distribu¬ 
tion  to  all  levels  within  the  material  acqui¬ 
sition  process,  regarding  DOT&E  oversight 
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of  systems  and  attendant  responsibilities 
and  requirements. 

OT&E  ISSUES 

The  OT&E  issues  for  the  HMMWV  Group 
H  variant  were:  mission  performance;  re¬ 
liability,  availability,  and  maintainability 
(RAM);  logistical  support-ability;  human 
factors  and  safety;  training;  and  transport¬ 
ability.  Evaluation  of  these  issues  in  April 
1988  led  USAOTEA  to  specify  four  con¬ 
cerns  regarding  identified  deficiencies. 
The  concerns  were:  deep-water  fording; 
lack  of  restraining  devices  in  ambulances; 
sharp  and  abrading  edges  in  ambulances; 
and  dust  conditions  in  the  rear  of  the  am¬ 
bulances. 

The  OT&E  issues  for  the  HMMWV 
Ml 069  are:  operational  mobility  while 
towing  the  light  howitzer  or  towed  vuican, 
RAM,  and  transportability. 

OT&E  ACTTVFY 

Testing  of  the  HMMWV  Group  II  included 
the  following:  an  Operational  Assessment 
(OA)  at  the  Fort  Lewis  and  Yakima  Firing 
Center  from  July  through  October  1987; 
First  Article/Initial  Production  Test  (FA / 
XPT)  at  Aberdeen  Proving  Ground,  Mary¬ 
land,  from  March  1987  through  February 
1988;  an  amphibious  compatibility  test  at 
the  Naval  Amphibious  Base,  Coronado, 
California,  from  October  1987  through 
March  1988  and  a  retest  at  the  same  loca¬ 
tion  in  September  1988;  and  an  ambu¬ 
lance  dust  test  at  Yuma  Proving  Ground, 
Arizona  in  October  1988.  USAOTEA  ob¬ 


tained  additional  data  at  the  contractor 
plant  in  Mishawaka,  Indiana,  in  July  1988. 

Testing  of  the  HMMWV  Ml  069  began 
at  Aberdeen  Proving  Ground,  Maryland  in 
January  1988  and  is  underway  at  this  writ¬ 
ing.  It  is  to  be  completed  in  December 
1988.  This  testing  has  been  and  will  con¬ 
tinue  to  be  observed  by  DOT&E. 

OT&E  ASSESSMENT 

The  USAOTEA  Interim  Independent 
Evaluation  Report  on  the  HMMWV  Group 
II  variant  dated  April  8,  1988,  identified 
four  concerns.  It  recommended  further 
assessment  of  these  areas  and  an  evalu¬ 
ation  of  the  adequacy  of  corrections  to  ve^ 
hides  prior  to  fielding  the  Group  II  variant 
HMMWVs,  At  a  meeting  between  the 
DOT&E  and  Army  personnel  in  July  1988, 
the  Director  requested  that  USAOTEA 
provide  an  interim  report  on  the  four  ar¬ 
eas  of  concern  by  mid-September  1988. 

The  USAOTEA-published  reassess¬ 
ment  report  dated  September  19,  1988 
recommended:  (1)  that  corrections  be  im¬ 
plemented;  (2)  that  all  four  areas  of  con¬ 
cern  be  reviewed  after  fielding  to  units; 
and  (3)  that,  with  the  project  manager  en¬ 
suring  all  corrective  actions  contained 
within  the  report  are  being  applied  to  pro¬ 
duction  vehicles  prior  to  release  and  to 
those  already  fielded,  there  was  no  reason 
to  delay  the  fielding.  We  concur  with 
those  recommendations  for  the  Group  II 
variant.  Our  next  Annual  Report  will  ad¬ 
dress  the  assessment  of  the  Ml  069 
HMMWV. 
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IMPROVED  RECOVERY  VEHICLE  (IRV) 


SYSTEM  DESCRIPTION 

The  Improved  Recovery  Vehicle  (IRV) 
program  includes  two  competing  candi¬ 
dates:  (1)  The  M88A1E1,  produced  by 
BMY,  is  a  product-improved  version  of 
the  current  M88A1  tank  recovery  vehicle. 
It  has  an  upgraded  powerpack,  increased 
winch  and  tow  capabilities,  increased  vehi¬ 
cle  weight,  an  upgraded  suspension  sys¬ 
tem,  and  increased  armor  protection.  It 
also  possesses  an  auxiliary  power  unit  for 
ancillary  tools.  (2)  The  Abrams  Recovery 
Vehicle  (ARV),  produced  by  the  General 
Dynamics  Land  Systems  Division  (GDLS), 
is  a  new  design  which  is  based  on  the 
M1A1  tank  chassis  and  includes  a  270-de¬ 
gree  rotational  crane,  an  automatic  fire 
detection  and  suppression  system,  and  an 
NBC  overpressure  and  protection  system. 


BACKGROUND 

A  fixed-price,  sole-source  contract  was 
awarded  to  BMY  in  January  1987  to  pro¬ 
vide  five  prototype  M88A1E1  vehicles  pur¬ 
chased  to  a  purchase  description  based  on 
the  M88A1E1  Required  Operational  Capa¬ 
bility  (ROC).  The  government  accepted 
an  offer  from  GDLS  to  provide  a  proto¬ 
type  ARV  for  test  and  evaluation  against 
the  M88A1E1  ROC.  A  one-dollar  con¬ 
tract  was  awarded  in  June,  1987  to  GDLS 
for  one  prototype  to  be  delivered  for  test 
no  later  than  May  15,  1988.  The  acquisi¬ 
tion  strategy  and  test  and  evaluation  pro¬ 
gram  were  modified  to  conduct  a  com¬ 
parative  test  of  one  M88A1E1  and  the  one 
ARV.  During  the  test  plan  review  process, 
DOT&E  inserted  the  requirement  that  an 
M88A1  be  included  as  a  calibration  of  test 
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difficulty.  To  provide  familiarization  with 
recovery  operations,  DOT&E  requested 
and  the  US  Army  Ordnance  Center  and 
School  provided  a  special  one-day, 
hands-on,  in-the-field  course.  Regular 
school  personnel  provided  instruction  at 
their  training  facility  at  Aberdeen  Proving 
Ground,  Maryland.  The  DOT&E  science 
advisor  and  two  DOT&E  staff  assistants 
attended  the  course,  along  with  others 
from  OSD  and  USAOTEA. 

OT&E  ISSUES 

The  following  are  OT&E  critical  issues  for 
IRV,  as  contained  in  the  DRV  Test  and 
Evaluation  Master  Plan  (TEMP),  approved 
by  OSD  on  July  25,  1988:  (1)  Does  the 
IRV  safely  tow  the  M1A1  in  an  operational 
environment?  (2)  Does  the  IRV  properly 
perform  recovery  and  maintenance  assis¬ 
tance  mission  tasks  (winch,  lift/winch,  lift) 
in  an  operational  environment?  (3)  Does 
the  IRV  demonstrate  reliability,  availabil¬ 
ity,  and  maintainability  (RAM;  character¬ 
istics  required  for  mission  accomplish¬ 
ment? 

OT&E  ACTIVITY 

A  side-by-side  Early  User  Test  and  Ex¬ 
perimentation  (EUT&E)  was  conducted  by 
the  US  Army  Armor  and  Engineer  Board 
at  Aberdeen  Proving  Ground,  (July  5-29, 
1988)  in  accordance  with  a  test  design  ap¬ 
proved  by  DOT&E.  The  purpose  of  the 
test  was  to  provide  user  test  data  and  in¬ 
formation  required  to  support  the  source 
selection  between  the  M88A1E1  and  the 
ARV.  One  prototype  of  each  and  a  cur¬ 


rent  M88A1  baseline  recovery  vehicle 
were  tested.  Four  military  crews  con¬ 
ducted  recovery  operations  encompassing 
the  winch,  lift,  and  tow  functions.  All  re¬ 
coveries  were  of  M1A1  tanks,  upweighted 
to  70  tons,  which  is  the  Army’s  declared 
weight  growth  limit  for  the  M1A1.  The 
test  focused  on  areas  of  operational  effec¬ 
tiveness;  it  was  not  sufficient  to  address 
operational  suitability  nor  was  it  expected 
to  do  so.  Testing  was  observed  by 
DOT&E. 

OT&E  ASSESSMENT 

The  results  of  EUT&E,  in  conjunction  with 
the  safety  release  limitations,  are  suffi¬ 
cient  to  determine  that  neither  candidate  is 
operationally  effective  in  the  tested  con¬ 
figuration.  Both  have  problems  with  main 
and  auxiliary  winches,  neither  meets  the 
requirement  for  towing  up  30  degree 
slopes,  and  the  ARV  has  exhaust  heat  and 
towbar  interference  problems. 

SUMMARY 

An  Army  Source  Selection  Evaluation 
Board  met  during  August  and  September 
1988  to  evaluate  both  DRV  candidates. 
The  Army  has  not  announced  a  decision 
on  the  direction  of  the  program  at  the  time 
of  this  writing.  DOT&E  is  an  active  par¬ 
ticipant  in  the  preparation  of  the  OT&E- 
based  portions  of  a  congressionally  man¬ 
dated  Secretary  of  Defense  certification 
that  the  tests  were  adequate,  the  results 
are  accurate,  and  the  chosen  system  is  the 
more  cost  effective  one. 
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SYSTEM  DESCRIPTION 

The  M1A1  tank  is  a  product  improvement 
of  the  Ml  tank.  It  incorporates  a  120  mil¬ 
limeter  gun  system,  a  microclimate  cool¬ 
ing  system  with  integrated  nuclear,  bio¬ 
logical,  chemical  (NBC)  protection,  a 
modified  power  and  drive  train,  and  in¬ 
creased  armor  protection.  Two  types  of 
120mm  ammunition  are  used  by  the 
M1A1:  the  M829  kinetic-energy  round, 
which  uses  a  depleted  uranium  penetrator; 
and  the  M830  high  explosive  anti-tank, 
shaped-charge  round.  The  120mm  am¬ 
munition  is  semicombustible,  leaving  only 
a  stub  metal  case  in  the  breech  after  fir¬ 
ing.  The  German  manufactured  tungsten 
alloy  penetrator  round  (DM23)  can  also  be 
fired  by  the  M1A1. 


BACKGROUND 

The  operational  test  was  managed  by  the 
Army's  Operational  Test  and  Evaluation 
Agency  (OTEA)  and  executed  by  the 
Training  and  Doctrine  Command  Com¬ 
bined  Arms  Test  Activity  at  Fort  Hood, 
Texas,  beginning  in  October  1983  and 
concluding  in  April  1984.  At  the  request 
of  the  DOT&E,  a  live-firing  test  by  sol¬ 
diers  of  production-like  service  ammuni¬ 
tion  was  added.  This  added  phase  was 
conducted  at  Aberdeen  Proving  Ground  in 
November  and  December  1984.  The  tests 
were  adequate  for  assessing  the  battlefield 
performance  of  the  full-scale  engineering 
development  model  tank.  DOT&E  re¬ 
ported  that  the  M1A1  tank  offered  signifi¬ 
cant  improvements  over  the  Ml  tank,  with 
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increased  firepower  and  added  armor  pro¬ 
tection,  and  found  it  to  be  operationally 
effective  and  suitable.  However,  we  also 
concluded  that  a  continuing  program  of 
follow-on  operational  test  and  evaluation 
(FOl&E)  would  be  required.  A  follow-on 
evaluation  (FOE)  of  the  M1A1  was  con¬ 
ducted  by  OTEA  during  the  period  Janu¬ 
ary  12  ~  June  30,  1987  at  Fort  Bliss, 
Texas,  with  the  3rd  Squadron,  3rd  Ar¬ 
mored  Cavalry  Regiment.  The  purpose  of 
the  FOE  was  to  determine  if  die  M1A1 
could  be  calibrated  using  the  procedures 
prescribed  in  Field  Circular  (FC) 
1 7-12-1  Al,  Tank  Combat  Tables;  that 
materiel  deficiencies  disclosed  during  the 
M1A1  Operational  Test  (OT)  n  had  been 
corrected;  that  the  M1A1  tank  could  be 
supported  with  planned  logistic  concepts; 
and  th3t  M1A1  tank  crews  could  effec¬ 
tively  use  the  on-board  NBC  system.  As  a 
result  of  the  test  plan  review  by  this  office, 
the  Army  revised  the  FOE  test  design  plan 
(TDP)  to  change  the  nature  of  the  test 
from  one  of  noninterference  with  the  3rd 
Armored  Cavalry  Regiment  training  activi¬ 
ties  to  one  of  minimal  interference  to  fa¬ 
cilitate  testing.  In  addition,  the  test  com¬ 
mand  structure  was  changed  to  place  the 
Commander  OTEA  clearly  in  charge,  with 
authority  to  interfere  with  the  unit’s  activi¬ 
ties  if  necessary  in  order  to  complete  all 
test  requirements  in  a  timely  manner. 

OT&E  ASSESSMENT 

Review  and  analyses  of  FOE  results  show 
that  the  testing  was  adequate  and  that 
many  old  problems  have  been  fixed,  some 
old  problems  remain,  and  new  problems 
emerged.  This  is  a  pattern  common  to 
such  tests.  Problems  or  concerns  that 
were  satisfactorily  resolved  include  main 
gun  calibration,  previous  pattern  failures, 
and  crew  use  of  the  on-board  NBC  sys¬ 
tem. 

Continuing  problems  were  encountered 
in  maintenance  and  logistical  support. 


The  special  test  measurement  and  diag¬ 
nostic  equipment  known  as  Support  and 
Test  Equipment  (STE-M1A1)  is  a  particu¬ 
lar  longstanding  problem.  It  comprises 
seven  boxes  of  equipment,  cables,  and 
adapters.  Usually,  more  than  one  soldier 
is  needed  to  run  any  given  test  effectively. 
The  equipment  cannot  continue  from  an 
interrupt,  but  must  restart  tests  from  the 
beginning.  It  requires  numerous  manuals 
and,  during  FOE,  required  an  average 
hook-up  time  of  over  35  minutes.  The 
return  for  this  investment  is  measured  in 
two  ways.  First,  half  the  soldiers  said  they 
thought  the  STE-M1A1  correctly  isolated 
a  faulty  component  between  75  and  80 
percent  of  the  time;  the  other  half  thought 
it  was  30  percent  of  the  time  or  less.  Sec¬ 
ond,  in  a  sample  of  32  instances  of  fault 
isolation  in  the  laser  range  finder,  hull  net¬ 
work  box,  and  turret  network  box  where 
STE-M1A1  at  organizational  level  indi¬ 
cated  bad  components,  direct  support  level 
agreed  that  12  were  bad;  for  the  laser 
range  finder,  direct  support  level  did  not 
agree  with  any  of  the  9  that  organization 
level,  using  STE-M1A1,  declared  bad. 
There  seems  to  be  little  hope  of  improve¬ 
ment  until  a  new  generation  of  built-in¬ 
test-equipment  is  developed.  In  summary, 
trouble  shooting  is  expected  to  remain  dif¬ 
ficult,  time  consuming,  and  uncertain.  In 
other  areas  of  logistical  support,  the  FOE 
showed  that  current  recovery  and  trans¬ 
port  capabilities  are  severely  challenged 
by  the  weight  of  the  M1A1  tank.  The 
weight  of  the  as-tested  (64  ton)  tank  has 
been  projected  to  increase  to  a  maximum 
of  70  tons.  The  Army  has  programs  in 
place  to  improve  both  recovery  and  trans¬ 
port,  but  developmental  problems  remain 
in  both.  Finally,  resupply  of  the  tested 
squadron  was  tenuous  in  terms  of  fuel 
handlers  and  repair  parts  vehicles  as  as¬ 
signed  under  the  Table  of  Organization 
and  Equipment  (TOE).  The  de-facto  but 
not  authorized  TOE  five-ton  trucks  per¬ 
mitted  the  organization  to  work.  The  lo¬ 
gistical  tail  currently  authorized  will  not 
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support  the  M1A1  squadron  and  needs  to 
be  increased. 

New  problems  that  have  been  identi¬ 
fied  include  engine  recuperator  cracks, 
generator  failures,  loader’s  seat  pins,  and 
personnel  heaters.  From  a  materiel  point 
of  view,  the  most  serious  is  the 
recuperator.  Fixes  have  been  developed 
by  tiie  project  manager's  office  and  are 
being  examined  in  technical  power-train 
durability  testing.  It  is  reported  that  the 
rest  have  been  solved,  but  test  results  are 


not  yet  available.  We  will  continue  to  pur¬ 
sue  and  address  this  subject  in  our  next 
Annual  Report. 

Finally,  our  last  Annual  Report  con¬ 
tained  a  preliminary  assessment  that  long- 
range  gunnery  should  be  tested,  We  are 
now  satisfied  that  sufficient  testing  has 
been  accomplished  in  the  2500-to-3000 
meter  range  band  and  that  additional 
long-range  engagements  need  not  be  sub¬ 
jected  to  operational  testing. 
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SYSTEM  DESCRIPTION 

The  M9  Armored  Combat  Earthmover 
(M9  ACE)  is  a  tracked,  lightly  armored, 
amphibious,  combat  engineer  vehicle  ca¬ 
pable  of  performing  dozing,  scraping, 
rough  grading,  towing,  and  limited  hauling 
missions.  It  was  developed  to  perform  the 
engineer  tasks  of  survivability  (e.g.,  pre¬ 
pare  fighting  positions  for  tanks),  mobility 
(e.g.,  breach  antitank  ditches),  and  coun¬ 
termobility  (e.g.,  dig  antitank  ditches). 

The  M9  ACE  has  a  hydraulic  suspen¬ 
sion  that  operates  in  two  modes:  sprung, 
for  use  for  travelling;  and  unsprung,  which 
allows  the  vehicle  to  be  raised,  lowered,  or 
tilted  for  working.  The  front  portion  of 
the  vehicle  is  an  open-top  box  known  as 


the  scraper  bowl,  or  ballast  compartment. 
The  front  of  the  bowl  is  opened  or  closed 
by  raising  or  lowering  the  apron  with  its 
integral  dozer  blade.  The  bowl  is  filted 
with  earth  by  raising  the  apron  and  mov¬ 
ing  forward  while  scraping.  Dropping  the 
apron  retains  the  earth  in  the  bowl  for  use 
as  ballast  to  improve  dozing  capability. 
The  ballast  is  emptied  by  raising  the  apron 
and  pushing  forward  with  a  hydraulic  ejec¬ 
tor  which  forms  the  rear  wall  of  the  bowl. 


The  M9  ACE  can  negotiate  cross¬ 
country  terrain,  attain  29  miles  per  hour 
road  speed,  swim  at  three  miles  per  hour, 
and  be  air  transported  in  C-130  and  larger 
aircraft.  It  provides  radio  communication, 
chemical  and  biological  protection  for  the 
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operator,  and  a  smoke  obscuration  capa¬ 
bility. 


BACKGROUND 


M9  ACE  development  started  in  1958  un¬ 
der  the  program  name  Universal  Engineer 
Tractor;  the  current  name  was  adopted  in 
1980.  Following  an  extended  series  of 
tests,  reviews,  and  changes,  15  M9  ACEs 
were  built  under  a  1982  contract.  In  1983 
the  Department  of  the  Army  directed  that 
in  a  scheduled  Initial  Production  Test 
(IPT)  at  Aberdeen  Proving  Ground  be  ex¬ 
panded  to  include  a  concurrent  Force  De¬ 
velopment  Test  and  Experimentation 
(FDT&E).  This  was  the  first  operational 
test  conducted  on  the  system.  In  August 
1984  the  Vice  Chief  of  Staff  of  the  Army 
directed  that  a  side-by-side  comparison  of 
the  M9  ACE  and  the  D7  dozer  system  be 
conducted  to  resolve  uncertainties  remain¬ 
ing  after  the  IPT/FDT&E  described  above. 
The  D7  system  includes  the  standard  me¬ 
dium  crawler  tractor,  the  M916  truck  trac¬ 
tor,  and  the  M172A2  lowbed  semitrailer. 
The  FOE  conducted  at  Fort  Hood,  Texas, 
by  the  US  Army  Training  and  Doctrine 
Command  Combined  Arms  Test  Activity, 
employed  seven  of  each  system.  The  re¬ 
sults  of  this  test  led  to  DOT&E  expression 
of  remaining  concerns  as  listed  under 
“OT&E  Issues,”  below.  Testing  to  address 
these  concerns  is  described  under  "OT&E 
Activity,”  below. 


OT&E  ISSUES 


Operational  testing  addressed  six  critical 
operational  issues-  mission  performance; 
survivability;  reliability,  availability,  and 
maintainability  (RAM);  logistical  support; 
human  factors;  and  safety.  In  addition, 
DOT&E  concerns  remaining  following  the 
1985  FOE  were  addressed  specifically  in 
the  operational  phase  of  the  1988  IPT. 
These  concerns  were:  operator  hatch, 


RAM,  productivity,  transition  to  produc¬ 
tion  from  the  technical  data  package,  and 
effectiveness  of  engineering  changes. 


OT&E  ACnVITY 


The  initial  production  test  operational 
phase  was  conducted  from  June  to  August 
1988  at  Aberdeen  Proving  Ground  under 
the  control  of  USAOTEA  and  the  US 
Army  Test  and  Evaluation  Command 
Combat  Systems  Test  Activity.  Six  M9 
ACE  vehicles  were  operated  and  main¬ 
tained  through  the  direct  support  level  by 
soldiers  of  proper  military  occupational 
specialty.  A  total  of  1805.8  operating 
hours  were  attained  under  approved  op¬ 
erational  mode  summary/mission  profile 
conditions.  The  purpose  of  the  test  was  to 
address  remaining  concerns  identified 
above. 


OT&E  ASSESSMENT 


DOT&E  finds  the  M9  ACE  to  be  opera¬ 
tionally  effective  and  suitable.  However,  it 
will  not  be  fielded  until  a  suitable  test  is 
performed  to  prove  that  required  fixes  are 
adequate  and  are  applied  to  all  produced 
vehicles.  The  remaining  items  to  be  fixed 
are:  drain  valve  durability;  steer  unit  tor- 
quelink  durability;  steer  unit  bolt  durabil¬ 
ity;  parking  brake  cable  durability;  brake 
chamber  bracket  durability;  and  hatch  du¬ 
rability.  All  of  these  can  be  adequately 
addressed  by  a  modest  expansion  of  the 
already  planned  and  contractually  re¬ 
quired  comparison  test  of  M9  ACE  vehi¬ 
cles'  performance  versus  contractual  re¬ 
quirements.  This  comparison  test  is  to  be 
monitored  by  USAOTEA  under  their  con¬ 
tinuous  and  comprehensive  evaluation 
(C2E)  methodology  and  results  reported  to 
DOT&E  by  means  of  a  C2E  update  report. 
Produced  M9  ACE  vehicles  may  be  allo¬ 
cated  to  and  used  by  the  Engineer  Center 
and  School  for  training  purposes.  All 
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fixes  must  be  certified  effective  by 
USAOTEA  prior  to  fielding  to  line  units. 

SUMMARY 

A  Beyond  Low-Race  Initial  Production  Re¬ 
port  was  submitted  by  DOT&E  on  Decem¬ 
ber  14,  1988. 


M9  ARMORED  COMBAT 
EARTHMOVER  (M9  ACE) 


III-33 


*<*£ 


sSSS*  f 
>v.w\^ 


SYSTEM  DESCRIPTION 

The  M939A2  5-ton  truck  series  has  17 
variants,  with  a  single  forward  axle  and 
tandem  rear  axles,  a  diesel  engine,  an 
automatic  transmission,  a  central  tire  in¬ 
flation  system  (CITS),  chemical  agent  re¬ 
sistant  coating  paint,  and  super  single 
tires.  The  most  common  of  the  variants 
are  the  M931A2  tractor,  the  M923A 2 
cargo  truck,  and  the  M936  wrecker.  The 
CT1S  control  assembly  is  mounted  on  the 
shift  column  of  the  truck  and  allows  the 
operator  to  adjust  the  tire  pressures  on  the 
truck  to  four  preset  positions.  Three  of 
these  are  normally  used  operational  posi¬ 
tions:  highway,  cross-country,  and  sand. 
Each  lower  position  decreases  the  tire 
pressure  for  increased  mobility.  The 
fourth  position  is  the  emergency  mode  and 


is  a  “last  resort”  when  the  vehicle  be¬ 
comes  stuck.  It  lowers  the  tire  pressure  to 
the  lowest  the  tire  will  allow  without 
breaking  the  bead.  There  is  also  a  run- 
flat  mode  that  pumps  pressure  into  the 
system  constantly  to  make  up  for  a  punc¬ 
tured  tire.  It  can  keep  a  punctured  tire 
inflated  long  enough  to  get  the  vehicle  to  a 
safe  place  to  change  tires. 

BACKGROUND 

The  M939A2  is  the  current  development 
in  a  series  of  trucks  that  began  with  the 
M809,  which  was  fielded  in  1951.  The 
M809/M939  Product  Improvement  Pro¬ 
gram  led  to  type  classification  of  the  M939 
in  1981.  The  M939A1  introduced  the  use 
of  super  single  tires  in  1985.  The 
M939A2  uses  a  new,  lighter  engine  than 
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previous  trucks  in  the  series.  The  M939 
trucks  have  not  previously  been  operation¬ 
ally  tested. 

OT&E  ISSUES 

The  issues  for  operational  test  and  evalu¬ 
ation  are:  (1)  Does  the  M939A2  meet  us¬ 
er  transport  requirements  in  an  opera¬ 
tional  environment?  (2)  Does  the  M939A2 
meet  reliability,  availability,  and  maintain¬ 
ability  (RAM)  requirements  in  an  opera¬ 
tional  environment?  (3)  Does  the  logistics 
support  of  the  M939A2  meet  established 
requirements  for  supply  and  maintenance 
in  an  operational  environment?  (4)  Does 
the  design  of  the  M939A2  provide  for 
transportability  (deployment)  that  meets 
mission  requirements?  (5)  Does  the 
M939A2  meet  or  exceed  human  factors 
engineering,  safety,  and  health  require¬ 
ments? 

OT&E  ACTIVITY 

Initial  operational  test  and  evaluation  was 
scheduled  to  be  conducted  by  the  US 
Army  Armor  and  Engineer  Board  at  Fort 
Knox,  Kentucky,  from  July  25,  through 
September  30,  1988.  On  July  14,  1988, 
having  received  neither  the  test  design 
plan  nor  the  Test  and  Evaluation  Master 
Plan,  DOT&E  requested  that  the  Army 
stop  spending  money  on  th.'  operational 
test  for  the  M939A2  unto  we  had  ap¬ 
proved  both  plans.  Op  ;uly  15  the  Army 
provided  a  test  design  plan  which  we  re¬ 
viewed.  We  found  the  plan  to  be  inade¬ 
quate  and  we  required  changes.  The  Test 
and  Evaluation  Master  Plan  was  provided 
on  July  25;  however,  it  required  modifica¬ 
tion  to  track  the  changed  test  design  plan. 
The  Army  cooperated  fully  with  changes 
and  rewrites  to  ensure  an  adequate  test, 
and  on  August  5,  1988,  DOT&E  gave  ver¬ 


bal  approval  to  start  testing.  Actual  test¬ 
ing,  which  was  observed  by  DOT&E,  be¬ 
gan  on  August  6  and  continued  through 
October  13. 

The  test  was  designed  for  conduct  with 
two  cargo  variants,  each  of  which  was  to 
be  run  a  minimum  of  2200  miles  in  accor¬ 
dance  with  a  defined  distribution  of  road 
types  and  toads.  One  tractor  variant  was 
to  accumulate  2600  miles  with  various 
trailers,  and  one  wrecker  variant,  also  to 
accumulate  2600  miles.  The  cargo  vari¬ 
ants  achieved  5765  miles,  whereas  the 
tractor  variant  was  driven  2633  miles. 
The  test  report  is  not  available,  but  the 
mileage  is  expected  to  be  adequate  to  as¬ 
sess  operational  effectiveness  and  opera¬ 
tional  suitability.  The  wrecker,  however, 
arrived  late  and,  because  oi  safety  release 
limitations,  was  not  completely  tested.  It 
was  precluded  from  winching,  and  this 
eliminated  testing  for  recovery  capability, 
a  major  part  of  wrecker  operations.  Lift 
capacity  for  the  boom  was  designed  to  be 
20,000  pounds,  but  safety  considerations 
limited  test  operations  to  10,000  pounds  or 
less.  Attempts  to  conduct  lift-tow  opera¬ 
tions  clearly  demonstrated  instability,  with 
incipient  front  wheel  lift-off  and  accompa¬ 
nying  uncertainty  in  directional  control. 
Although  final  data  are  not  available,  the 
wrecker  variant  will  require  a  substantial 
design  review,  modification,  and  retest. 

OT&E  ASSESSMENT 

At  the  time  of  this  writing,  final  data  and 
evaluation  are  not  available.  Emerging  re¬ 
sults  suggest  that  variants  other  than  the 
wrecker  must  go  through  a  series  of  cor¬ 
rective  actions  and  check  testing.  The 
wrecker  variant  will  require  a  substantial 
design  review,  modification,  and  retest. 
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SYSTEM  DESCRIPTION 

The  Army  Maneuver  Control  System 
(MCS)  is  a  command  and  control  system 
to  aid  in  the  effective  employment  and  op¬ 
erational  control  of  the  tactical  maneuver 
force,  as  part  of  the  overall  force  level  and 
maneuver  control  system.  Automated 
transmittal,  storage,  retrieval  and  display 
of  battlefield  information  is  intended  to 
improve  handling  of  message  traffic  loads 
and  reaction  times  and  demonstrate  the 
potential  for  automatic  interaction  with  in¬ 
formation  systems.  Echelons  from  ma¬ 
neuver  battalion  through  corps  are 
planned  to  have  such  assistance  in  the 
form  of  the  MCS  computer  network. 

MCS  has  been  programmatically  and 
technically  restructured  several  times,  with 


the  latest  system  structure  being  an  um¬ 
brella  MCS  system  consisting  of  a  mixture 
of  various  separate  computer  systems  and 
technologies.  These  include  a  military 
specification  system  known  as  the  Tactical 
Computer  Terminal  (TCT)  and  the  TCT 
Prime  (TCT  with  bubble  memory)  in  the 
production  and  limited  field  use  phase;  a 
later  ruggedized  commercial  system 
known  as  the  Tactical  Computer  Processor 
(TCP)  and  Analyst  Console  (AC)  which 
recently  proceeded  beyond  the  low-rate 
initial  production  (LRIP)  phase  (in  fact,  a 
total  buy-out)  and  referred  to  as  non-de¬ 
velopment  items  (NDIs);  and  future  com¬ 
mon  hardware  and  software  which  is  in 
the  development  and  LRIP  phase  under 
the  Army  Command  and  Control  System 
(ACCS)  program. 
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Earlier  system  structures  that  included 
military  specification  versions  of  the  Tacti¬ 
cal  Operations  System  fTOS)  and  Tactical 
Computer  System  (TCS)  have  been  termi¬ 
nated.  Militarized  computers  and  periph¬ 
eral  devices  are  to  occupy  critical  or  se¬ 
vere  nodes  within  the  netted  MCS  system, 
while  NDI  computers  and  peripheral 
equipment  are  being  considered  for  less 
critical  stations.  TCT,  TCT  Prime,  TCP, 
and  AC  procurements  address  brigade  to 
corps  levels  (except  battalion)  and  are  cur¬ 
rently  structured  to  transfer  to  the  reserves 
when  the  ACCS  hardware  is  available, 
tested,  and  integrated  into  the  system. 
MCS  applications  programs  are  written  in 
Ada  software  language. 

BACKGROUND 

Development  of  the  TCS  and  TCT  started 
in  1975  as  part  of  the  TOS  program.  TOS 
was  terminated  in  1979  and  MCS  initiated, 
consisting  of  the  TCS  and  TCT.  Prototype 
devices  were  deployed  to  Europe  in  1980 
and  1981.  The  Army  approved  the  re¬ 
quired  operational  capability  (ROC)  for 
the  MCS  on  June  30,  1982.  In  a  May  1983 
Army  Systems  Acquisition  Review  Council 
(ASARC)  the  MCS  was  type  classified  as 
standard  and  the  TCTs  and  TCS  entered 
full-scale  production.  In  addition,  the  in¬ 
vestigation  of  a  NDI  development  to  paral¬ 
lel  the  military  specification  item  develop¬ 
ment  was  directed,  with  excessive  cost 
being  the  driving  factor.  This  led  to  Octo¬ 
ber  1983  guidance  to  provide  a  limited 
quantity  of  the  military  specification 
equipment  to  the  entire  active  force  and  to 
supplement  it  with  NDI  hardware  in  those 
locations  where  enhanced  survivability 
was  not  absolutely  essential.  The  TCP 
was  selected  as  an  NDI  surrogate  to  the 
TCT  in  1984. 

In  February  1986,  the  Army  deter¬ 
mined  that  the  operational  value  of  the 
TCS  did  not  justify  its  cost,  leading  to  ter¬ 
mination  of  TCS  procurement  and  transfer 
of  its  bubble  memory  to  some  TCTs 


(called  TCT  Prime)  to  replace  the  TCS 
and  a  decision  to  initiate  procurement  of 
NDI  TCPs.  Related  guidance  was  pro¬ 
vided  by  the  Vice  Chief  of  Staff  of  the 
Army  in  February  and  May  1986  to  con¬ 
duct  adequate  testing  to  support  future  de¬ 
cisions.  Based  on  this  guidance,  agree¬ 
ments  between  Army  test  and  evaluation 
and  combat  development  communities 
identified  three  test  requirements:  suc¬ 
cessful  completion  of  a  follow-on  evalu¬ 
ation  I  (FOE-I)  to  support  TCT/TCT 
Prime  fielding  decisions;  successful  com¬ 
pletion  of  an  operational  assessment  (OA) 
to  support  FY87  procurement  orders  of 
NDI  TCPs;  and  successful  completion  of 
an  FOE-II  of  the  full-up  MCS  system  with 
all  military  specification  and  NDI  compo¬ 
nents  to  support  FY88  NDI  orders. 


The  FY88  Appropriations  Act  con¬ 
tained  a  tasking  for  Army  and  DoD  to  re¬ 
port  on  an  innovative  strategy  for  opera¬ 
tional  test  and  evaluation  of  MCS  to 
permit  evolutionary  development  and 
fielding.  An  Army  strategy  was  forwarded 
to  the  Chairman  of  the  House  Committee 
on  Appropriations  on  June  7,  1988. 
DOT&E  agreed  in  general  with  this  strat¬ 
egy,  which  required  more  detail  to  ensure 
that  both  MCS  operational  suitability  test¬ 
ing  and  sufficient  operational  realism  of 
the  full-up  MCS  were  incorporated  into 
testing  to  permit  adequate  evaluation. 
DOT&E  approved  a  Maneuver  Control 
Evaluation  (MCE)  plan  for  providing  early 
equipment  and  equipment  operator  infor¬ 
mation  to  support  an  evolutionary  develop¬ 
ment  and  testing  of  MCS  with  the  under¬ 
standing  that  it  was  not  an  adequate 
OT&E  to  confirm  operational  effectiveness 
and  suitability  of  the  system  for  missions 
in  typical  combat.  This  July  11,  1988,  ap¬ 
proval  was  with  the  understanding  that  ad¬ 
ditional  details  would  be  included  in  the 
MCE  effort  prior  to  FY88  procurement  de¬ 
cisions,  and  that  adequate  follow-on  op¬ 
erational  tea  and  evaluation  (FOT&E) 
would  be  planned  and  conducted. 
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OT&E  ISSUES 

The  MCS  has  passed  through  various  sys¬ 
tems  engineering  phases  and  decisions 
since  1975.  These  phases  have  not  been 
supported  with  results  from  traditional  op¬ 
erational  test  and  evaluation  (OT&E).  At¬ 
tempts  have  been  made  to  obtain  results 
from  these  various  systems  being  deployed 
to  VII  Corps  since  1981  for  field  experi¬ 
ence  and  feedback  to  support  development 
and  procurement  decisions.  The  MCS 
hardware  has  been  procured  and  is  par¬ 
tially  fielded  without  mature  supporting 
software  to  provide  effective  operational 
combat  capability  or  support  capability  to 
provide  operational  suitability.  Availability 
of  sufficient  memory  for  incorporation  of 
functional  software  and  current  plans  to 
pass  responsibility  for  accreditation  of  the 
system  to  process  classified  information  to 
the  using  field  commander  are  of  concern. 

NDI  equipment  procurement  became 
two-phased,  with  the  first  phase  awarded 
in  July  1987  as  an  LRIP  which  constituted 
about  45  percent  of  the  total  planned  NDI 
program.  FOT&E-H  for  the  full-up  MCS 
system  with  militair  specification  and  NDI 
components  was  first  delayed  from  FY88 
to  FT89,  and  has  subsequently  been  re¬ 
placed  by  ACCS  testing  in  the  third  quar¬ 
ter  of  FY91  in  a  TEMP  submitted  in  July 
1988.  The  innovative  NDI  component 
MCE  was  completed  without  inclusion  of  a 
mission-commander-level  assessment  of 
the  benefits  and  utility  of  MCS  hardware 
with  Segment  10  software  functions  in 
realistic  combat  missions.  The  July  1988 
TEMP  proposes  an  operational  assessment 
based  on  tests  at  DJ  Corp  in  the  fourth 
quarter  of  FY89  to  support  Army  Materiel 
Release  decisions  for  MCS. 

On  September  29,  1988,  the  Army  pro¬ 
ceeded  to  expend  FY88  funding  for  the 
NDI  full-rate  production  order  (actually  a 
total  buy  of  all  MCS  hardware  prior  to  the 
availability  of  ACCS)  without  adequate 
operational  test  and  evaluation,  without  a 


determination  of  operational  effectiveness 
and  suitability,  without  OSD  approval  of 
the  TEMP  for  adequate  FOT&E,  and  with¬ 
out  the  DOT&E  beyond  low-rate  initial 
production  report  to  the  Secretary  of  De¬ 
fense  and  the  Congress. 

OT&E  ACTIVITY 

In  March  1981  the  Vice  Chief  of  Staff  of 
the  Army  approved  fielding  of  engineering 
development  versions  of  the  TCS  and  TCT 
to  VII  Corps  and  judgement  of  their  per¬ 
formance  in  a  number  of  field  exercises  in 
place  of  traditional  OT&E.  These  field  ex¬ 
ercises  have  included:  Vn  Corps  Com¬ 
mand  Post  Exercise  (CPX)  in  May  and 
September  1981;  Field  Training  Exercise 
(FTX)  in  September  1982;  CPX  in  March 
1983;  and  FTX  in  September  1984.  The 
Army’s  Training  and  Doctrine  Command 
(TRADOC)  Combined  Arms  Test  Activity 
(TCATA)  was  designated  as  the  test  or¬ 
ganization  and  conducted  evaluations  of 
MCS  during  these  exercises.  TCATA  con¬ 
ducted  the  TCP  OA  at  Fort  Carson,  Colo¬ 
rado,  from  July  28  to  August  1,  1986,  and 
the  TCT/TCT  Prime  FOT&E-I  in  Europe, 
April  25-29,  1987,  issuing  test  reports  in 
September  1986  (TCP  OA)  and  September 
1987  (TCT/TCT  Prime  FOT&E-I).  OTEA 
directed  the  OA  and  FOT&E-I  and  issued 
its  independent  operational  assessment 
(IOA)  reports  in  April  24,  1987  (TCP 
OA),  June  1987  (interim  draft  TCT/TCT 
Prime  FOT&E-I),  and  March  1988  (final 
assessment  report  on  FOT&E  I). 

This  office  did  not  observe  either  the 
OA  or  the  FOT&E-I  because  the  TEMP 
and  OT  plan  were  not  approved  for  ade¬ 
quacy  of  OT&E  to  determine  operational 
effectiveness  and  suitability.  We  and 
OTEA  outlined  improvements  required  to 
the  TEMP  on  September  11,  1987.  The 
Army  did  not  proceed  with  this  test  strat¬ 
egy,  but  did  seek  congressional  direction 
in  the  FY88  budget  appropriations  process 
to  require  an  Army  and  DoD  report  on  an 
innovative  operational  test  strategy  to 
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permit  evolutionary  development  and 
fielding  of  MCS. 

A  summary  of  the  Army  test  strategy 
was  forwarded  to  the  Chairman  of  the 
House  Committee  on  Appropriations  in 
May  1988.  The  DOT&E  agreed  in  general 
with  this  strategy,  with  additional  detail 
being  required  in  the  TEMP  and  OT  Plan 
to  ensure  that  operational  suitability  test¬ 
ing  and  sufficient  operational  realism 
would  be  incorporated  into  the  Maneuver 
Control  Evaluation  (MCE)  phase  to  permit 
adequate  evaluation.  The  Army  was  also 
advised  that  the  OT  Plan  must  be  ap¬ 
proved  prior  to  commencement  of  the 
MCE  phase,  and  the  TEMP,  prior  to  the 
FY88  NDI  option.  The  Army  submitted  a 
MCE  plan  to  execute  a  controlled  experi¬ 
ment  without  the  additional  details  re¬ 
quired  to  permit  adequate  evaluation. 
DOT&E  approval  of  the  MCE  was  based 
on  inclusion  and  completion  of  details  out¬ 
lined  in  an  attachment  to  a  July  11,  1988 
memorandum.  These  details  included: 
assessments  will  consider  both  the  hard¬ 
ware  and  Segment  10  software  utility  for 
realistic  combat  missions;  the  operators 
will  assess  the  benefits  and  utility  of  MCS 
hardware  with  Segment  10  software  func¬ 
tions;  a  mission-commander-level  assess¬ 
ment  of  the  benefits  and  utility  of  MCS 
hardware  with  Segment  10  software  func¬ 
tions  in  realistic  combat  missions  will  be 
provided;  a  DOT&E  report  will  be  submit¬ 
ted  prior  to  the  FY88  NDI  option  award 
and  will  consider  the  MCE  results,  MCE 
assessment  reports  by  the  Army’s  OTEA, 
and  details  outlined  above  for  inclusion  in 
the  MCE. 

The  MCE  was  executed  as  a  program 
manager/contractor  controlled  field  ex¬ 
periment  in  August  1988  at  Fort  Lewis, 
Washington.  The  MCE  did  not  include  the 
details  called  for  in  the  July  11,  1988, 
DOT&E  memorandum.  Representatives 
from  DOT&E  observed  portions  of  the 
MCE.  The  program  manager/contractor 
report  was  issued  on  September  15,  1988, 


and  an  AMSAA  report  was  issued  on  Sep¬ 
tember  26,  1988.  The  OTEA  report  was 
issued  in  November  1988.  A  DOT&E  re¬ 
port  is  being  prepared. 

OT&E  ASSESSMENT 

OTEA  concluded  that  the  NDI  TCP  pro¬ 
vided  for  the  July  1986  OA  has  the  poten¬ 
tial  to  emulate  some  of  the  functions  and 
capabilities  of  the  military  specification 
TCT.  However,  the  usefulness  and  func¬ 
tionality  of  the  complete  MCS  could  not 
be  evaluated  due  to  communication  inter¬ 
face  failures,  the  lack  of  a  full  comple¬ 
ment  of  TCT/TCT  Primes,  and  the  imma¬ 
turity  of  the  software. 

OTEA  found  that  the  TCT/TCT  Prime 
as  fielded  during  the  April  1987  FOT&E-I 
made  a  marginal  contribution  to  opera¬ 
tional  effectiveness.  OTEA  reported  that 
the  results  of  FOT&E-I  would  not  support 
the  fielding  or  materiel  release  of  the  fully 
militarized  (TCT/TCT  Prime)  equipments 
at  this  time.  OTEA  has  also  suggested  a 
force  development  test  and  experimenta¬ 
tion  (FDT&E)  to  learn  how  to  develop  and 
use  MCS  in  the  field. 

OTEA  found  that  the  NDI  TCP  and  AC 
could  be  powered  by  tactical  power  and 
netted  with  the  military  specification  TCT/ 
TCT  Prime,  a  local  area  network,  and  se¬ 
lected  military  communications  equip¬ 
ments  during  the  August  1988  MCE.  The 
NDI  could  be  transported  in  tactical 
wheeled  vehicles  and  operated  by  military 
operators  in  accordance  with  the  MCE 
controlled  experiment  plan.  Software  was 
not  mature  and  simply  provided  a  means 
for  passing  messages. 

The  DOT&E  assessment  is  that  ade¬ 
quate  operational  test  and  evaluation  has 
not  been  performed  on  MCS  and  that  re¬ 
sults  of  past  test  and  evaluation  activity  do 
not  confirm  the  operational  effectiveness 
and  suitability  of  either  the  military  or  the 
NDI  equipment.  An  innovative  test  strat¬ 
egy  such  as  FDT&E  with  functional  soft- 
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ware  may  aid  in  development  of  an  effec¬ 
tive  and  suitable  system,  and  a  realistic 
mission  level  FOT&E  will  be  required  to 
provide  test  results  necessary  to  support 
informed  decisions  on  any  additional  pro¬ 
curement  cr  fielding  decisions  of  MCS  or 
ACCS. 

SUMMARY 

MCS  has  not  been  adequately  tested  in  the 
field  and  has  not  demonstrated  opera¬ 


tional  effectiveness  or  operational  suitabil¬ 
ity  for  typical  users  in  typical  combat  sce¬ 
narios.  Additional  system-level  OT&E,  to 
include  a  mission-commander-level  and  a 
combat  mission  oriented  test,  is  required. 
An  approved  TEMP  and  an  approved  OT 
plan  are  required  to  plan  clearly  and  pro¬ 
vide  the  necessary  resources  to  confirm 
MCS  operational  effectiveness  and  suit¬ 
ability. 
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SYSTEM  DESCRIPTION 

The  Mobile  Subscriber  Equipment  (MSE) 
system  is  a  complete  tactical  communica¬ 
tions  system  that  is  designed  to  satisfy  the 
essential  area  communications  at  division 
and  corps  levels  throughout  the  Army.  The 
purpose  of  the  system  is  to  provide  highly 
mobile  secure  digital  communications  ca¬ 
pable  of  providing  users  with  voice,  data, 
and  facsimile  service.  The  system  is  auto¬ 
matic,  self-organizing,  and  uses  flood 
search  routing  to  enable  subscribers  to  re¬ 
tain  their  telephone  number  and  enter  the 
network  regardless  of  their  location  on  the 
battlefield.  MSE  is  intended  to  provide 
commanders  and  their  staff  with  a  much 
needed  mobile  communications  capability 
not  available  with  piesent  sysiems.  It  con¬ 
sists  of  five  functional  area*  ,vhich  inter¬ 


operate  with  each  other,  providing  a  grid, 
or  backbone,  network  of  communications 
nodes  deployed  throughout  the  corps  and 
division  areas  of  operations. 

BACKGROUND 

The  MSE  program  used  a  competitive 
non-developmental  item  (NDI)  acquisition 
strategy  which  was  designed  to  take  ad¬ 
vantage  of  available  technology  and  avoid 
a  lengthy  developmental  period.  The  key 
to  the  acquisition  strategy  is  the  total-sys¬ 
tem  concept:  a  turn-key  operation  which 
includes  the  communications  system 
equipment,  generators,  vehicles,  and  sup¬ 
port  equipment.  This  is  the  first  time  that 
the  Army  has  ever  purchased  a  totally  in¬ 
tegrated/turn-key  tactical  communications 
system  from  one  contractor.  In  November 
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1982,  the  Under  Secretary  of  the  Army 
provided  the  initial  guidance  to  implement 
the  NDI  approach  toward  acquiring  the 
MSE  system.  In  July  1984  the  Army  re¬ 
leased  a  solicitation  package  to  industry 
which  supported  the  NDI  approach.  A 
source  selection  evaluation  board  was  con¬ 
vened  to  evaluate  the  industrial  proposals. 
The  MSE  contract  was  subsequently 
awarded  to  General  Telephone  and  Elec¬ 
tronics  (GTE)  and  signed  in  December 
1985.  The  Army  exercised  its  Option 
Year  1  decision  coincidentally  with  its  de¬ 
cision  to  let  the  basic  contract.  Option 
Year  2  was  awarded  in  February  1987. 
Option  3  was  awarded  on  December  6, 
1988,  based  upon  the  results  of  an  FOT&E 
conducted  August  9  through  October  25, 
1988.  The  next  milestone  is  award  of  con¬ 
tract  Option  4,  scheduled  for  March  1989. 

Throughout  the  past  year  DOT&E  has 
been  actively  involved  in  the  test  planning 
process,  including  review  of  the  Test  and 
Evaluation  Master  Plan  (TEMP),  the  Test 
Design  Plan  (TDP),  and  on-site  observa¬ 
tions  of  the  preparatory  testing  accom¬ 
plished  at  the  contractors  facilities  and  at 
Fort  Hood,  Texas.  DOT&E  also  attended 
numerous  test  planning  meetings  and  con¬ 
ducted  on-site  observations  during  the 
FOT&E.  DOT&E  required  the  inclusion  of 
operational  testing  as  part  of  the  MSE  ac¬ 
quisition  strategy  prior  to  the  execution  of 
the  MSE  Option  3  award.  DOT&E’s  re¬ 
view  of  the  test  -Mans  resulted  in  the  inclu¬ 
sion  of  a  limited  oaseline  comparison  and 
a  limited  assessment  of  the  MSE  perform¬ 
ance  under  EW  conditions.  DOT&E  re¬ 
viewed  the  FOT&E  results  and  the  Army’s 
Interim  Independent  Evaluation  Report 
(EER)  and  published  an  assessment  which 
was  forwarded  to  Congress  on  December 
7,  1988. 

OT&E  ISSUES 

The  Army  identified  three  critical  opera¬ 
tional  issues  and  a  series  of  supporting  is¬ 
sues.  The  critical  operational  issues  ad¬ 
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dressed  the  following  areas:  provision  of  a 
division  and  corps  communications  net¬ 
work  that  will  meet  the  required  grade  of 
service  (GOS),  the  ability  of  the  system  to 
be  restored  or  to  reestablish  communica¬ 
tions  after  an  outage  or  destruction  of  a 
node,  and  the  ability  of  MSE  subscribers 
to  communicate  with  echelons  above  corps 
(EAC),  commercial  networks,  other  US 
forces,  and  NATO  units. 

OT&E  ASSESSMENT 

The  first  complete  division  set  of  MSE 
equipment  was  delivered  to  Fort  Hood  in 
February  1988  and  began  destination  and 
final  acceptance  testing  (DFAT).  Follow- 
on  operational  test  and  evaluation 
(FOT&E)  of  the  MSE  system  began 
August  9,  1988,  and  was  completed  Octo¬ 
ber  25,  1988.  The  FOT&E  was  originally 
scheduled  to  begin  in  May  1988,  but  was 
delayed  due  to  unanticipated  problems 
which  surfaced  during  the  pre-FOT&E  ac¬ 
tivities  when  the  MSE  system  went  to  the 
field  as  a  complete  system.  All  contractor 
testing  prior  to  fielding  had  been  success¬ 
ful,  and  all  features  had  been  demon¬ 
strated  in  individual  components  as  well 
as  in  a  limited  system  configuration.  The 
three-month  delay  was  used  to  isolate  and 
fix  problems  that  surfaced  during  the 
fielding  process.  DOT&E  encouraged  the 
Army  to  delay  FOT&E  until  the  Army  was 
confident  that  the  MSE  system  could  sat¬ 
isfy  the  FOT&E  test  requirements.  Prior 
to  the  start  of  FOT&E,  the  test  unit  con¬ 
ducted  a  division-level  command  post  ex¬ 
ercise  to  verify  the  fixes  and  ensure  the 
system  was  ready. 

The  Army  published  an  evaluation  re¬ 
port  on  November  8,  1988,  based  on  the 
FOT&E  and  judged  the  system  to  be  op¬ 
erationally  effective  and  suitable.  DOT&E 
considers  the  FOT&E  adequate  to  support 
an  assessment  of  MSE  effectiveness  and 
suitability  to  perform  its  mission  of  pro¬ 
viding  a  division-area  communications 
system.  In  a  relatively  short  period  of 
time,  the  MSE  non-developmental  item 
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(NDJ)  strategy  has  fielded  a  complete  divi¬ 
sion  set  of  equipment.  DOT&E  considers 
the  operational  suitability  and  effective¬ 
ness  of  MSG  to  be  adequate  at  this  level  of 
maturity.  However,  the  FOT&E  recorded 
areas  of  concern  where  criteria  were  not 
met.  The  failure  to  achieve  the  required 
call  completion  rate  (CCR),  switch  fail¬ 
ures,  and  apparent  software  problems  are 
three  of  the  most  serious  concerns.  Based 
upon  the  deficiencies  noted  during  FOT&E 
and  the  necessity  to  ensure  system  effec¬ 
tiveness  at  the  corps  level  in  an  EW  envi¬ 
ronment,  DOT&E  has  insisted  that  the 
Army  conduct  a  series  of  verification  tests 
and  operational  assessments  to  ensure  that 
identified  problems  are  corrected  and  ap¬ 


propriate  means  are  in  place  to  withhold 
funds  if  the  corrections  arc  not  accom¬ 
plished  satisfactorily. 

SUMMARY 

The  Army  has  initiated  a  corrective  action 
plan  to  correct  the  deficiencies  identified 
during  and  prior  to  the  FOT&E.  Also,  ap¬ 
propriate  draft  TEMP  changes  have  been 
prepared.  In  addition,  the  MSE  contrac¬ 
tor,  GTE,  has  agreed  to  the  corrective  ac¬ 
tion  plan  and  has  signed  a  contract  modifi¬ 
cation  which  incorporates  this  plan. 
DOT&E  will  monitor  the  progress  of  the 
corrective  actions  to  ensure  progress  to¬ 
ward  the  identification  and  resolution  of 
known  problems. 
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OH-58D  SCOUT  HELICOPTER  (AHIP) 


SYSTEM  DESCRIPTION 


The  Army  Helicopter  Improvement  Pro¬ 
gram  (AHIP)  deve'oped  the  OH-58D 
Scout  Helicopter  through  major  modifica¬ 
tion  of  existing  OH-58A  helicopters.  The 
OH-58D  Scout  was  designed  to  provide  a 
day/night  limited  adverse  weather  com¬ 
mand  and  control,  surveillance,  and  target 
acquisition  capability,  and  a  capability  to 
designate  targets  for  laser  homing  muni¬ 
tions.  The  mast-mounted  sight  is  in¬ 
tended  to  enhance  OH-58D  survivability 
by  allowing  surveillance,  target  acquisition 
and  target  designation  from  extended 
stand-off  ranges  with  minimal  exposure 


of  the  helicopter  to  enemy  radar  and 
electro-optical  detection  devices. 

BACKGROUND 

An  operational  test  n  (OT  H)  was  con¬ 
ducted  at  Fort  Hunter  Liggett,  California, 
from  September  1984  to  February  1985  to 
provide  the  information  necessary  to  as¬ 
sess  operational  effectiveness  and  suitabil¬ 
ity.  Overall,  the  testing  was  conducted  in 
as  realistic  an  operational  environment  as 
could  be  obtained  within  time  and  safety 
constraints. 

On  the  basis  of  our  assessment  of  the 
results  of  OT  II,  this  office  concluded  that: 
the  OH-58D  demonstrated  an  operation- 
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ally  effective  capability  in  the  field  artil¬ 
lery  aerial  observer  role.  However,  in  the 
attack  and  air  cavalry  roles,  the  OH-58D 
offered  no  statistically  significant  advan¬ 
tage  in  combat  effectiveness  over  the 
existing  OH-58C  helicopter.  Due  to  ob¬ 
served  shortcomings  in  tactical  employ¬ 
ment,  training  and  doctrine,  further  opera¬ 
tional  tests  were  required  to  support  use  of 
OH-58D  in  these  two  roles.  We  further 
concluded  that  while  the  OH-58D  is  gen¬ 
erally  suitable  for  use,  improvement  to  the 
mast-mounted  sight  and  control  data  sys¬ 
tem  designation  accuracy,  reliability,  and 
fault  detection  and  isolation  were  re¬ 
quired. 

In  view  of  the  DOT&E  assessment,  the 
Defense  Systems  Acquisition  Review 
Council  (DSARC)  recommended  produc¬ 
tion  of  the  OH-58D  for  the  field  artillery 
aerial  observer  role  only.  The  Secretary 
of  Defense  Decision  Memorandum  dated 
October  8,  1985  directed  the  Army  to  pro¬ 
cure  sufficient  OH-58D  helicopters  to  sup¬ 
port  the  field  artillery  aerial  observer  role 
only.  It  also  directed  the  Army  to  proceed 
immediately  to  plan  for  the  conduct  of  a 
follow-on  operational  test  to  establish  the 
effectiveness  and  suitability  of  the 
OH-58D  in  the  attack  and  air  cavalry 
roles.  Planning  for  this  test  was  underway 
when  the  Army  determined  it  could  no 
longer  afford  the  OH-58D,  and  in  early 
1987  the  Army  Chief  of  Staff  terminated 
the  program  and  the  planned  test.  How¬ 
ever,  recognizing  that  air  cavalry  units 
need  scout  aircraft,  and  responding  to  con¬ 
gressional  interest,  the  Army  decided  to 
redesign  and  redesignate  the  test  from  the 
OH-58D  FOT&E  to  the  Army  Aerial 
Scout  Test  (AAST),  Phase  I  and  D.  The 
purpose  of  these  tests  was  to  compare  al¬ 
ternative  systems  (OH-58C,  OH-58C+, 
AH-64A,  AH-1S(MC)  and  AH- IS  C- 
Nite)  to  the  baseline  OH-58D.  Phase  I 
was  to  be  concerned  with  the  scout/recon¬ 


naissance  role;  and  Phase  n,  with  the  at¬ 
tack  team  role. 

As  the  focus  of  the  Phase  I  test  evolved 
from  the  OH-58D  to  the  more  general 
“candidate  evaluation,”  Army  plans  elimi¬ 
nated  some  elements  of  the  issues  identi¬ 
fied  by  DOT&E;  these  included  live-fire 
and  AHIP  readiness  and  suitability  for  sus¬ 
tained  operations.  These  elements  were 
scheduled  to  be  examined  in  the  Phase  n 
test.  The  Army  originally  intended  to  con¬ 
duct  the  AAST,  Phase  n,  during  1988; 
however,  it  has  not  yet  funded  this  test. 

The  Army  officially  notified  OSD  on 
June  28,  1988,  of  its  intention  to  reinstate 
the  OH-58D  program.  Thus,  this  office 
prepared  its  report  (September  9,  1988) 
supplementing  the  1985  report  submitted 
in  fulfillment  of  the  provisions  of  Title  10, 
USC  138. 

OT&E  ISSUES 

Phase  I  of  the  AAST  was  conducted 
March  through  May  of  1987  at  Fort 
Hunter  Liggett  by  the  US  Army  Opera¬ 
tional  Test  and  Evaluation  Agency 
(OTEA).  The  test  was  designed  to  provide 
the  basis  for  the  Army  to  determine  the 
best  interim  aeroscout,  prior  to  Light  Heli¬ 
copter  Experimental  (LHX).  The  candi¬ 
dates  were  OH-58C,  OH-58C+,  AH- IS 
(Modernized  Cobra)  (MC),  AH-64A,  and 
the  OH-58D,  which  was  considered  the 
baseline.  Another  candidate,  the  prototype 
AH-1S  C-Nite,  was  added  for  the  tactical 
obscuration  subtest  only.  The  test  was 
preceded  by  a  comprehensive  train-up 
and  validation  period  and  an  exploratory/ 
validation  effort.  The  helicopters  were  op¬ 
erated  and  maintained  at  the  unit  level  by 
military  personnel.  Maintenance  above 
Aviation  Unit  Maintenance  (AVUM)  level 
for  all  aircraft  was  provided  by  contract 
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Eersonnel  from  Sikorsky  Support  Services, 

1C. 

The  AAST  addressed  this  single  test  is- 
sue:  In  the  scout/reconnaissance  role, 
what  is  the  capability  of  the  available  can- 
didates  (OH-58C,  OH-58C+,  AH-1S 
(MC),  AH-64A)  to  perform  Army  aeros- 
cout  functions  as  compared  to  the  baseline 
OH-58D? 

The  planned  testing  was  approved  by 
this  office,  and  members  of  the  DOT&E 
staff  observed  the  conduct  of  the  test  and 
the  processing  and  analysis  of  the  data  by 
the  Army. 

There  were  numerous  test  limitations. 
However,  they  do  not  invalidate  the  meas¬ 
ured  results,  since  they  were  generally 
consistent  for  each  of  the  candidates 
evaluated.  The  exact  degree  to  which  ob¬ 
served  individual  aeroscout  performance 
values  are  affected  by  the  various  limita¬ 
tions  is,  however,  unknown.  The  specific 
limitations  are  in  the  classified  final  re¬ 
port. 

OT&E  ASSESSMENT 

The  record  trials  for  the  AAST,  Phase  I 
consisted  of  navigation  trials,  reconnais¬ 
sance  trials,  and  the  tactical  obscuration 
subtest  trials.  Each  trial  contained  day  and 
night  missions. 

NAVIGATION  TRIALS 

The  ability  to  navigate  and  get  to  points  on 
the  battlefield  quickly  and  reliably  is  a 
prerequisite  to  beginning  a  mission  in  en¬ 
emy  territory.  The  time  to  traverse  the 
specific  distance  directly  influences  the  re¬ 
sponsiveness  to  mission  orders.  The  fuel 
consumed  influences  the  length  of  time 
available  for  the  remainder  of  the  mission. 
Because  the  space  and  instrumentation  at 
Fort  Hunter  Liggett  are  limited,  separate 


trials  were  designed  to  test  the  navigation 
capabilities  of  the  helicopters. 

During  the  navigation  trials,  candidate 
aeroscout  helicopters  were  required  to 
navigate  tactically  over  predetermined 
routes/courses.  The  OH-58C+  and  the 
AH- IS  C-Nite,  which  incorporate  no  navi¬ 
gation  improvements  beyond  their  less  so¬ 
phisticated  counterparts,  were  not  tested. 

Within  the  confines  of  Fort  Hunter  Lig¬ 
gett,  four  different  navigation  routes  were 
established  over  terrain  covered  by  instru¬ 
mentation.  The  routes  were  designed  to 
avoid  major  valley  areas  where  ridge  lines, 
roads,  stream  beds,  and  other  distinguish¬ 
ing  terrain  features  could  become  familiar 
to  crews  over  time.  Each  course  consisted 
of  a  start  point,  at  least  five  checkpoints, 
and  a  release  point.  The  course  distance 
between  the  start  point  and  the  release 
point  varied  from  38  to  53  kilometers. 
Each  crew  was  required  to  report  as  the 
scout  aircraft  flew  over  any  check  point. 

Fifty-two  validated  navigation  trials 
were  run  and,  in  general,  they  were  run 
before  each  reconnaissance  trail.  They  do 
not  include  three  OH-58C  trails  for  which 
the  navigation  course  was  not  completed. 

The  navigation  trials  were  to  ascertain 
which  scout  could  best  do  the  following: 
(1)  successfully  complete  (i.e.,  transit 
from  start  point  to  each  checkpoint  to  re¬ 
lease  point)  navigation  routes;  (2)  mini¬ 
mize  the  flight  time  required  to  complete 
navigation  routes;  and  (3)  accurately  ad¬ 
here  to  navigation  routes. 

In  general,  there  is  a  trade-off  between 
speed  and  accuracy  in  that  the  additional 
accuracy  can  be  obtained  by  sacrificing 
speed.  The  tactical  significance  of  these 
subissues  can  be  interpreted  from  the  per¬ 
spective  of  an  end-to-end  scout  mission 
involving  an  initial  navigation  portion  fol¬ 
lowed  by  a  reconnaissance  portion.  The 
scout  will  not  be  able  to  fulfill  its  mission 
unless  it  actually  reaches  the  reconnais- 
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sance  area.  The  longer  the  scout  takes  to 
fly  to  the  reconnaissance  area,  the  less 
time  will  be  available  for  reconnaissance. 
Finally,  flying  outside  the  prescribed  navi- 
ation  corridor  could  expose  the  scout  to 
ostile  fire. 

The  OH-58C’s  performance  in  the 
navigation  trials  would  be  expected  to  be 
hampered  by  the  absence  of  an  on-board 
inertial  navigation  system.  The  remaining 
participants  all  possessed  various  versions 
of  a  Doppler  navigation  system.  In  addi¬ 
tion,  the  OH-58C  was  the  only  participat¬ 
ing  scout  that  relied  solely  on  NVGs  as  a 
night  flying  aid. 

With  the  exception  of  three  OH-58C 
trials  (one  day  trial  and  two  night  trials), 
all  attempts  to  navigate  the  prescribed 
courses  were  successfully  completed. 
Three  OH-58C  trials  were  terminated  by 
test  control  either  because  the  scout  was 
lost  or  because  of  time  limitations  (i.e., 
persistent  wandering  requires  too  much 
time  to  recover  and  finish  the  course). 

Our  conclusions  from  the  analysis  of 
the  navigation  trials  can  be  summarized  as 
follows:  (1)  the  OH-58C,  the  only  partici¬ 
pant  scout  lacking  a  Doppler  navigation 
system,  failed  to  complete  three  naviga¬ 
tion  trials.  All  other  scout  types  completed 
every  trial.  (2)  Even  when  the  OH-58C 
completed  a  navigation  trial,  it  took  sig¬ 
nificantly  more  time  than  any  of  the  other 
scout  types.  (3)  No  statistically  significant 
differences  in  time  to  complete  courses 
were  detected  between  the  OH-58D, 
AH-1S(MC),  and  AH-64A. 

Post-test  interviews  with  the  crews  in¬ 
dicated  that  the  observed  differences  in 
performance  in  this  portion  of  the  test 
may,  in  part,  result  from  differences  in 
crew  attitudes  and  experiences.  Crews  that 
had  been  scouts  previously  (i.e.,  prior  to 
training  for  the  AAST,  Phase  I)  indicated 
that  they  spent  more  time  on  preparation 
and  precise  mission  planning  (for  exam¬ 


ple,  by  adding  additional  checkpoints  to 
the  navigation  routes)  than  crews  with  at¬ 
tack  helicopter  experience. 

RECONNAISSANCE  TRIALS 

An  aeroscout  must  survive  on  the  battle¬ 
field.  In  order  to  provide  useful  recon¬ 
naissance  information  to  the  battlefield 
commander,  the  aeroscout  must  detect, 
identify,  and  locate  the  enemy  and  com¬ 
municate  that  information  in  a  timely 
manner.  The  reconnaissance  trials  of  the 
AAST,  Phase  l,  tested  the  ability  of  vari¬ 
ous  scout  candidates  to  determine  which 
one  could  best  perform  these  tasks.  Some 
candidates  might  have  been  good  detec¬ 
tors  of  targets,  but  could  not  survive,  while 
others  might  have  been  good  survivors  but 
could  not  detect  many  targets. 

A  scout  team,  composed  of  a  scout 
helicopter  and  an  escort  attack  helicopter, 
was  required  to  reconnoiter  a  section  of 
territory  suspected  to  be  occupied  by  the 
enemy.  They  were  given  approximately 
one  hour  to  perform  their  reconnaissance. 
The  enemy  consisted  of  five  different  tar¬ 
get  arrays  (clusters  of  individual  targets/ 
vehicles),  a  total  of  approximately  30  vehi¬ 
cles.  The  test  scenario  and  the  scope  and 
ratio  of  opposing  forces  were  selected 
from  the  then  current  SCORES  scenario 
for  the  defense  of  Central  Europe  in  the 
1991  time  frame.  Smoke  and  camouflage 
of  threat  arrays  were  not  employed  during 
reconnaissance  trails  because  of  a  belief 
that  they  would  have  seriously  degraded 
the  performance  of  instrumentation  equip¬ 
ment  considered  critical  to  developing 
data  on  detection,  recognition  and  surviv¬ 
ability  measures  of  performance. 

To  minimize  the  effects  of  learning 
and  familiarization  with  routes  through  the 
terrain,  eight  different  tactical  target 
laydowns  of  threat  force  ground  target  ar¬ 
rays  were  presented  to  Blue  Force  recon¬ 
naissance  teams.  The  combination  of  ter¬ 
rain  vegetation  along  with  clever  selection 
of  the  general  location  of  the  array  made 
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target  detection  by  the  scout  teams  a  very 
difficult  task. 

Day  and  night  counterattack  missions 
were  chosen  for  the  test.  The  mission  for 
the  tested  teams  was  to  determine  and  re¬ 
port  on  enemy  strengths  and  distributions 
without  becoming  ngaged.  A  secondary 
mission  was  to  des'.  '■oy  any  priority  targets 
(enemy  air  defense  and  tactical  operation 
centers)  encountered. 

The  assigned  mission  required  the 
aeroscout  to  cross  the  test  start  point,  ori¬ 
ent  on  the  general  area  in  which  the  first 
target  array  was  located,  and  initiate  re¬ 
connaissance.  After  detection  and  report¬ 
ing  tasks  were  completed  for  an  array  or 
upon  order  of  the  task  force  operations  of¬ 
ficer,  the  aeroscout  shifted  its  attention  to 
the  next  array.  The  scout  and  its  attack 
helicopter  could  simulate  engaging  enemy 
ground  defenses  through  direct  or  indirect 
fire  to  facilitate  continuing  to  the  next  ar¬ 
ray. 

Similarly,  the  enemy  ground  weapon 
systems  could  simulate  engagement  of  the 
scout  or  attack  helicopter.  A  probability 
of  hit  for  each  engagement  of  scout  heli¬ 
copters  by  ground  air  defenses  was  calcu¬ 
lated.  These  probabilities  were  used  to  de¬ 
termine  the  survivability  of  a  helicopter 
during  its  mission. 

The  scout  team  received  credit  for 
each  target  correctly  reported  and  ac¬ 
knowledged.  The  reported  target  location 
and  type  were  compared  to  actual  target 
location  and  type.  The  report  was  scored 
as  correct  only  if  both  attributes  were  ac¬ 
curately  reported.  The  scout  received 
credit  for  the  report  only  if  its  higher 
headquarters  acknowledged  receipt  of  the 
report. 

The  analyses  of  reconnaissance  trials 
include  only  those  recorded  engagements 
for  which  all  parameters  satisfied  the 
weapons  methodology  for  employment. 


Engagements  scored  as  “multiple”  (i.e., 
occurring  within  15  seconds  of  an  initial 
engagement  or  a  preceding  multiple  en¬ 
gagement  of  a  specific  Red  defense  sys¬ 
tem  against  a  specific  Blue  helicopter) 
were  not  included  in  the  analyses,  either 
because  of  a  lack  of  realistic  weapon  en¬ 
gagement  signatures  or  because  of  incom¬ 
patibility  with  combat  capabilities.  The 
conclusions  reported  do  not  change  if  all 
multiple  engagements  are  incorporated 
into  the  analyses.  Only  the  particular  val¬ 
ues  of  the  measure  of  performance  would 
change. 

Overall,  the  OH-58D  detections  and 
reportings  per  trial  were  considerably 
higher  than  the  OH-58C.  For  the  early 
trials,  the  two  candidates  reported  about 
the  same  number  of  targets  per  trial.  Af¬ 
ter  trial  10,  there  was  a  sharp  increase  in 
the  detection  and  reporting  rate  (per  trial) 
for  the  OH-58D.  The  point  at  which  the 
increase  began  corresponds  to  the  trial  in 
which  the  OH-58D  crews  and  mainte¬ 
nance  personnel  first  learned  to  adjust  tne 
FIJR  correctly.  Deletion  of  the  early  trials 
would  have  enhanced  the  OH-58D  per¬ 
formance  relative  to  the  other  candidates. 

The  AH-1$(MC)  reported  fewer  tar¬ 
gets  per  trial,  then  the  OH-58D  and 
OH-58C  and  the  AH-64A  and  0H-58O 
reported  even  fewer  targets  per  trial. 

While  the  total  number  of  targets  re¬ 
ported  is  a  useful  measure  of  battlefield 
information,  a  commander  might  also  be 
interested  in  the  depth  to  which  targets  are 
deployed.  The  average  number  of  target 
arrays  reported  is  a  measure  of  how 
“deep”  into  the  enemy’s  position  a  scout 
can  penetrate.  After  trial  10,  the  OH-58D 
was  able  to  penetrate  deepest  with  the 
OH-58C  second.  The  other  candidates  re¬ 
ported  far  fewer  arrays  per  trial. 

Reporting  targets  is  only  part  of  the 
story,  since  some  candidates  may  have 
had  to  assume  relatively  more  risk  than 
others  to  achieve  a  given  report  rate  per 
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trial.  For  a  single  trial,  the  scout  survival 
probability  is  the  product  of  the  individual 
survival  probabilities  associated  with  each 
engagement  against  the  scout.  The 
OH-58D  had  the  highest  survival  prob¬ 
ability  of  any  of  the  candidates. 

Although  the  confidence  intervals  were 
large,  there  was  little  overlap  of  those  in¬ 
tervals  between  the  OH-58D  and  the  other 
candidates.  The  histogram  of  survival 
probability  for  each  candidate  was 
bimodal,  with  modes  near  zero  and  one. 
This  explains  why  the  confidence  intervals 
are  large  and  means  that,  in  most  cases, 
scout  candidates  on  a  reconnaissance  trial 
were  either  engaged  quite  often  or  not  at 
all. 

The  limited  number  of  engagements 
against  the  OH-58D  may  have  been  partly 
attributable  to  its  ability  to  detect  targets 
at  longer  standoff  ranges.  The  OH-58D, 
equipped  with  a  mast-mounted  FliR,  de¬ 
tected  targets  further  out  than  any  of  the 
other  candidate  aeroscouts. 

As  previously  noted,  certain  test  condi¬ 
tions/limitations  may  have  contributed  to 
the  performance  exhibited  by  the  candi¬ 
dates.  First,  there  was  no  Blue  ground 
force  to  distract  the  FST  and  BMP  gunners 
(highest  number  of  engagements).  Conse¬ 
quently,  these  gunners  were  able  to  con¬ 
centrate  on  searching  for  Blue  helicopters. 
Second,  the  Red  threat  included  more 
FSTs  and  BMPs  than  other  systems.  Fi¬ 
nally,  scouts  did  not  often  penetrate  very 
deeply  into  the  laydown  of  target  arrays. 
Since  the  Red  air  defense  systems  were 
generally  deployed  in  the  rear  arrays, 
(fewest  engagements)  they  may  not  have 
had  comparable  numbers  of  opportunities 
to  engage  the  Blue  helicopters. 

The  OH-58D  has  the  highest  average 
report  probability.  The  ability  of  all  the 


candidates  to  report  additional  targets  and 
arrays  may  have  been  restricted  by  the 
one  hour  trial  limit. 

The  OH-58D  performed  reconnais¬ 
sance  more  effectively  during  the  day  and 
night  than  the  OH-58C  and  the 
OPH-58C+. 

In  order  to  isolate  the  potential  influ¬ 
ence  of  a  lack  of  flash  simulators  in  night 
trials  (flashes  would  ordinarily  accompany 
engagements),  analyses  focused  on  aero- 
scout  target  reporting  performance  during 
the  time  periods,  beginning  with  trial  start 
and  ending  with  first  engagement  by  the 
defense.  During  these  periods,  on  the  av¬ 
erage,  the  OH-58D  reported  twice  as 
many  target  arrays  than  either  the 
OH-58C  or  the  AH-64A,  and  more  than 
three  times  as  many  target  arrays  as  the 
OH-58C  or  the  AH-64A,  and  more  than 
three  times  as  many  target  arravs  as  the 
OH-58C+  or  the  AH-1S(MC).  Similarly, 
in  terms  of  individual  targets,  on  the  aver¬ 
age,  the  OH-58D  reported  more  than  3.5 
times  as  many  targets  as  either  the  OH- 
58C  or  the  AH-64A,  and  nearly  five  times 
as  many  targets  as  either  the  OH-58C+  or 
the  AH-1S(MC). 

In  conclusion,  the  OH-58D  had  the 
highest  target  and  array  reporting  rates 
per  trial,  the  highest  chance  of  surviving 
the  reconnaissance  mission,  and  the  best 
chance  of  both  surviving  and  reporting  tar¬ 
gets  or  arrays.  All  the  other  candidates 
performed  less  effectively  than  the  OH- 
58D.  Except  for  the  comparison  between 
the  average  number  of  arrays  reported  by 
the  OH-58D  versus  the  OH-58C,  all  of 
these  differences  were  statistically  signifi¬ 
cant,  with  90  percent  confidence.  The 
OH-58D  was  engaged  far  fewer  times 
than  any  of  the  other  aeroscout  candi¬ 
dates.  This  may  be  due  to  its  ability  to 
detect  targets  from  longer  standoff  ranges 
and  the  mast-mounted  sight.  An  addi- 
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tional  factor  was  that  the  average  Pk  per 
engagement  was  lowest  for  the  OH-58D. 

TACTICAL  OBSCURATION  SUBTEST 

To  provide  a  measure  of  the  effects  of  ob¬ 
scurants,  a  subtest  was  conducted.  Both 
day  and  night  trials  were  run,  each  under 
benign  (i.e.,  no  smoke)  and  obscured  (i.e., 
smoke)  conditions. 

There  were  three  different  positions 
from  which  aircrews  were  allowed  to  de¬ 
tect,  recognize,  and  locate  targets  within 
five  different  target  arrays.  The  ranges  to 
the  arrays  varied  between  2000  and  4500 
meters.  The  altitude  of  the  aircraft  was 
just  high  enough  to  permit  direct  line-of- 
sight  over  the  intervening  ridge  line  into 
the  target  arrays. 

Target  arrays  were  rotated  among 
seven  different  locations  in  the  valley. 
This  rotation  of  target  arrays  was  done  be¬ 
tween  sets  of  trials  so  that  each  tested 
crew  would  observe  the  same  target  ar¬ 
rangement.  After  all  crews  had  seen  an 
arrangement,  the  targets  were  relocated 
for  the  next  set.  One  array  was  always 
camouflaged.  Each  crew  was  allowed  five 
minutes  of  observation  time  per  trial. 

The  OH-58D  generally  performed 
most  effectively  across  all  tested  condi¬ 
tions  during  the  tactical  obscuration  sub¬ 
test  trials.  The  only  exception  was  the 
AH-64A  in  day  obscured  trials.  The  other 
FLIR-equipped  aeroscouts  (the  AH- IS  C- 
Nite,  OH-58C+,  and  AH-64A)  performed 
better  than  the  AH-1S(MC)  and  the 
OH-58C,  neither  of  which  possesses  a 
FLIR.  These  rankings  held  for  both  day 
and  night  trials.  Since  smoke  and  camou¬ 
flage  were  not  played  during  the  recon¬ 
naissance  trials,  the  results  and  analyses 


of  these  trials  are  biased  in  favor  of  the 
non-FLER-equipped  scouts,  i.e.,  in  favor 
of  the  OH-58C  and  the  AH-1S(MC)  rela¬ 
tive  to  the  OH-58D,  AH-64A,  and 
OH-58C+. 

The  climate  at  Fort  Hunter  Liggett  did 
not  challenge  the  candidates  under  hign 
altitude  hot  conditions.  The  flight  enve¬ 
lopes  for  the  AH-64A  and  the  OH-58D 
generally  exceed  those  of  the  AH-1S  and 
the  OH-5  SC.  Neither  the  AH-1S  nor  the 
OH-58C  can  readily  conduct  extremely 
low  level  terrain  following  missions.  Only 
the  OH-58D  and  the  AH- 64 A  have  a 
hover  and  vertical  climb  capability  under 
high/hot  conditions.  Thus,  only  these  two 
aircraft  are  capable  of  conducting  opera¬ 
tional  missions  in  all  areas  of  the  world. 

SUMMARY 

The  OH-58D  demonstrated  a  clear  superi¬ 
ority  over  the  other  candidates  for  the 
scout/reconnaissance  role.  In  the  recon¬ 
naissance  trials,  it  located  and  reported 
more  enemy  targets  per  trial  while  simul¬ 
taneously  maintaining  the  highest  mission 
survivability  rate.  The  OH-58D  also  de¬ 
tected  the  greatest  number  of  targets  per 
trial  for  each  of  the  conditions  examined 
in  the  tactical  observation  subtest,  and 
during  navigation  trials  its  performance 
either  exceeded  or  equaled  that  cf  the 
other  candidates.  Reliability,  availability, 
and  maintainability  (RAM)  data  and  sup- 
portability  data  were  not  collected  during 
the  Phase  I  test.  Recent  congressional  di¬ 
rection  that  all  future  purchases  of  the 
OH-58D  have  the  structural  and  electrical 
modifications  to  accommodate  the  armed 
reconnaissance  configuration,  will  require 
a  reassessment  of  aircraft  operational  suit¬ 
ability  issues. 
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SYSTEM  DESCRIPTION 

Regency  Net  includes  a  new  secure  and 
anti-jam  high-frequency  (HF)  radio  com¬ 
munication  system  to  replace  an  existing 
system.  The  intent  is  to  provide  a  new 
system  with  the  required  security,  surviv¬ 
ability,  flexibility,  control,  reliability, 
maintainability,  and  capability  to  counter 
jamming  threats.  The  primary  purpose  of 
Regency  Net  is  to  provide  the  US  Com- 
mander-in-Chief  Europe  (CINCEUR)  and 
his  tri-Service  commanders  with  a  secure, 
survivable,  flexible,  and  fully  supportable 
HF  radio  communications  system  for 
voice  and  data  in  a  stressing  wartime  envi¬ 
ronment.  The  secondary  purpose  is  to 
provide  HF  communications  capability  for 
internal  CINCEUR  and  supporting-Service 
command  requirements  on  a  noninter¬ 


ference  basis.  Interoperability  across 
Service  lines  was  an  intended  capability. 

BACKGROUND 

The  Regency  Net  program  was  initiated  as 
a  non-developmental  item  (NDI)  program 
by  the  Army  in  1983.  This  decision  was 
based  on  several  statements  of  need  and 
urgency.  The  Army  awarded  the  Regency 
Net  contract  in  December  1983. 

Contractor  testing,  known  as  Pilot  Net¬ 
work  System  Test-1  (PNST-1),  was  in¬ 
cluded  in  the  contract.  PNST-1  was  to  be 
completed  prior  to  exercise  of  production 
options  which  were  included  in  the  fixed 
price  contract  and  scheduled  for  comple¬ 
tion  in  39  months.  The  program  was  not 
reviewed  at  Army  Systems  Acquisition  Re¬ 
view  Council  (ASARC)  level  for  milestone 
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decisions  and  did  not  include  independent 
operational  test  and  evaluation  (OT&E)  by 
the  Army  Operational  Test  and  Evaluation 
Agency  (OiEA).  Regency  Net  is  not  a 
major  DoD  acquisition  program,  but  on 
April  23,  1986,  was  designated  by  the 
DOT&E  for  oversight  in  accordance  with 
10  USC  138.  Problems  experienced  dur¬ 
ing  developmental  efforts  led  to  schedule 
delays.  DOT&E  and  OTEA  met  with  the 
Regency  Net  program  manager  and  con¬ 
tractor  at  the  contractor  plant  on  July  22, 
1986,  to  explain  the  policy  and  require¬ 
ments  of  DOT&E  oversight.  The  Army  re¬ 
structured  the  contract  in  March  1987, 
almost  a  year  after  DOT&E  designation  of 
Regency  Net  for  oversight,  and  provided 
for  concurrent  completion  of  developmen¬ 
tal  efforts  and  award  of  production  op¬ 
tions  beyond  low-rate  initial  production 
(LRIP)  without  results  of  PNST-1  or  OT&E 
to  support  the  decision. 

PNST-1  was  conducted  August  29  to 
September  29,  1987,  after  award  of  the 
production  options.  PNST-1  was  unsuc¬ 
cessful  in  demonstrating  compliance  with 
the  contract  and  operational  effectiveness. 
The  contractor  test  report  of  results  was 
rejected  by  the  Army  in  December  1987 
and  a  CURE  notice  issued.  It  is  under¬ 
stood  that  the  contractor  responded  to  the 
CURE  notice  in  May  1988.  Details  of  test 
results  and  additional  test  plans  have  not 
been  provided  to  OSD  for  review  and  ap¬ 
propriate  approval  or  guidance. 

OT&E  ISSUES 

The  Army  proceeded  beyond  LRIP  after 
designation  of  the  Regency  Net  program 
for  DOT&E  oversight  and  without  conduct 
of  approved  OT&E  to  support  the  procure¬ 
ment  actions.  This  office  was  not  con¬ 
sulted  or  advised  concerning  program 
changes  or  contract  restructuring  with 
award  of  production  orders  beyond  the 
LRIP.  It  is  understood  that  OTEA  and  the 
Deputy  Under  Secretary  of  the  Army  (Op¬ 


erations  Research)  have  discussed  conduct 
of  an  independent  OT&E.  However,  the 
required  Test  and  Evaluation  Master  Plan 
(TEMP),  OT&E  concept  brief,  and  opera¬ 
tional  test  (OT)  plan  have  not  been  pro¬ 
vided  to  OSD. 

Requirements  are  still  being  reviewed 
for  Service  agreement  and  JCS  approval 
of  HF  interoperability  for  voice  and  data 
communications  in  a  jamming  environ¬ 
ment.  Each  Service  continues  with  sepa¬ 
rate  programs. 

OT&E  ACTIVITY 

No  OT&E  was  planned,  conducted,  or  re¬ 
ported  during  FY87  or  FY88.  A  draft 
TEMP  was  provided  to  this  office  infor¬ 
mally,  and  comments  were  returned,  in¬ 
cluding  an  expression  of  the  requirement 
for  independent  OT&E. 

A  meeting  was  chaired  by  the  DOT&E 
in  May  1987  at  which  the  Army  was  re¬ 
minded  OT&E  is  required  for  Regency  Net 
and  is  to  be  preceded  by  an  approved 
TEMP,  an  OT&E  concept  brief,  and  a 
DOT&E-approved  OT  plan.  OTEA  subse¬ 
quently  prepared  an  outline  OT  plan  for 
Army  review  and  projected  OT&E  to  be 
conducted  in  FY88.  However,  the  Army 
has  made  no  attempt  to  provide  this  office 
with  an  Army-approved  TEMP,  OT  con¬ 
cept  brief,  and  an  OT  plan;  and  results 
from  PNST-1,  the  development  test  which 
was  conducted  in  1987.  Our  last  under¬ 
standing  is  that  a  PNST-1A  would  start  no 
earlier  than  October  1988,  and  an  Army 
OT&E  is  now  being  planned  in  FY89. 

OT&E  ASSESSMENT 

This  office  provided  OT&E  policy,  proce¬ 
dures,  guidance,  and  consultation  to  the 
Army,  including  the  Regency  Net  program 
manager.  OT&E  has  not  been  conducted 
to  support  procurement  beyond  LRIP. 
OT&E  has  not  been  adequate  and  results 
are  not  available  to  confirm  that  Regency 
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Net  items  are  effective  and  suitable  for 
combat. 

Informal  indications  that  reports  of 
past  test  results  and  plans  for  future  test¬ 
ing  in  a  TEMP  would  be  forwarded  to 
DOT&E  were  encouraging.  It  appears  that 
an  Army  Material  Release  decision  (to 
field  the  system  or  not)  is  the  primary  re¬ 
maining  Regency  Net  program  decision 
which  can  be  influenced  by  operational 
test  and  evaluation.  Operational  test  and 
evaluation  should  be  completed  to  assure 
completion  of  Service  interoperability  re¬ 
quirements  formulation  and  execution  for 
continuing  HF  communications  system 
programs. 


SUMMARY 

Regency  Net  development  efforts  are  not 
complete.  The  Regency  Net  contract  was 
restructured  in  1987,  and  production  op¬ 
tions  beyond  LRIP  were  exercised  before 
conduct  of  PNST-1  or  OT&E.  Results 
from  PNST-1,  PNST-1A,  and  any  poten¬ 
tial  operational  test  and  evaluation  activity 
must  be  reported  and  evaluated.  Regency 
Net  OT&E  has  not  been  adequately 
planned  or  initiated  to  date.  A  TEMP,  an 
OT  concept  brief,  and  OT  plan  are  still 
required  to  provide  adequate  OT&E  re¬ 
sults  for  assessment  and  reporting  of  Re¬ 
gency  Net  operational  effectiveness  and 
suitability. 
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SYSTEM  DESCRIPTION 

The  Army  Single  Channel  Ground  and 
Airborne  Radio  System  (SINCGARS)  is  a 
major  DoD  acquisition  program  in  the 
low-rate  initial  production  (LFJP)  phase 
for  the  original  design  from  the  first  pro¬ 
duction  contractor.  SINCGARS  is  a  VHF- 
FM  combat  net  radio  communications  sys¬ 
tem  to  provide  secure  and  anti-jam 
command  and  control  communications  ca¬ 
pability  for  infantry,  artillery  and  armor 
units  critical  to  the  conduct  of  lana  battle. 
The  SINCGARS  family  of  radios  is  in¬ 
tended  to  be  capable  of  transmitting  voice, 
tactical  data,  and  record  traffic  in  a  fre¬ 


quency  hopping  or  single  channel  (fre¬ 
quency)  mode. 

The  primary  role  of  SINCGARS  is  to 
provide  for  a  more  reliable  secure  voice 
trc  nsmission  for  the  maneuver  force  com¬ 
mander  to  use  in  command  and  control. 
A  secondary  responsibility  is  to  provide 
for  data  transmission  while  maintaining 
voice  message  priority  on  the  network. 
Exceptions  to  this  data  transmission  appli¬ 
cation  are  use  of  SINCGARS  with  the  ex¬ 
isting Tactical  Fire  Direction  System 
(TACF1RE)  and  with  the  projected  Army 
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Field  Artillery  Tactical  Data  System 
(AFATDS)  on  exclusive  data  networks. 

BACKGROUND 

Different  configurations  of  SINCGAJRS  are 
being  provided  to  replace  the  current  AN/ 
VRC-12  family  of  standard  vehicular  ra¬ 
dios  and  the  AN/PRC-77  manpack  radio 
series.  Army  development  and  LRIP  of  an 
airborne  S1NCGARS  radio  is  also  under¬ 
way  to  replace  the  AN/ARC-54/131  fam¬ 
ily,  AN/ARC-114  and  AN/ARC-186  (PM 
only)  airborne  radios  in  Army  aircraft. 
The  Air  Force  and  Navy  are  proceeding 
with  separate  developments  of 
SlNCGARS-interoperable  airborne  and 
shipboard  radio  systems.  Army  develop¬ 
ment  to  integrate  the  National  Security 
Agency  (NSA)  communications  security 
(COMSEC)  function  into  SINCGARS  is 
called  ICOM  (for  Integrated  COMSEC) 
and  nearing  completion.  Decisions  to  pro¬ 
duce  the  ICOM  configuration  began  with 
an  engineering  change  proposal  (ECP)  to 
change  2000  of  the  Option  2  LRIP  radios 
from  the  original  to  an  ICM  design. 
ICOM  is  now  the  Army’s  objective  system 
design.  A  second  source  has  been  se- 
'  *r  build  iCOM  configurations  that 
'  U'  fit  anti  function  interchangeable 
and  interoperable  with  the  firjt-souroc  de¬ 
sign. 

A  limited  operational  test  (LOT)  was 
conducted  by  the  Army  Operational  Test 
and  Evaluation  Agency  (OTEA)  using  four 
advanced  development  model  SINCGARS 
radios  from  the  two  competing  contractors 
in  November  1982.  These  test  results 
were  used  to  support  the  Army  decision  to 
accelerate  from  advanced  development  to 
selection  of  an  LRIP  design  in  an  attempt 
to  provide  a  1985  initial  operational  capa¬ 
bility  (IOC).  A  maturity  operational  test 
(MOT)  was  conducted  at  Fort  Riley,  Kan¬ 
sas,  from  October  through  December  1983 
by  OTEA  to  provide  information  to  vali¬ 
date  the  Army  LRIP  decision.  Operational 
reliability  demonstrated  during  MOT  was 


less  than  400  hours  mean  time  between 
failure  (MTBF)  against  a  requirement  for 
1250  hours  MTBF.  Operational  perform¬ 
ance  deficiencies  during  MOT  included 
complex  operations  to  establish  and  main¬ 
tain  communications  nets,  loss  of  vari¬ 
ables  (hopset,  lockouts,  net  identification, 
time/day,  and  security),  and  built-in-test. 
The  contractor  made  some  radio  modifica¬ 
tions  which  were  retested  during  an  opera¬ 
tional  assessment  (OA)  conducted  from 
August  through  September  1984  at  Fort 
Huachuca,  Arizona.  Additional  data  were 
gathered  from  emerging  results  of  devel¬ 
opment  tests  conducted  at  Fort  Huachuca 
and  Fort  Sill,  Oklahoma.  Based  on  these 
OA  and  emerging  results  the  Army 
awarded  LRIP  Options  1  and  2,  respec¬ 
tively  3200  (FY84  funded)  and  8250 
(FY85  funded)  SINCGARS  radios. 

The  contractor  experienced  reliability 
and  other  problems  in  transferring  from 
advanced  development  to  production, 
which  led  to  an  extensive  reliability- 
growth  and  problem-fixing  effort.  The 
contractor  completed  this  extended  reli¬ 
ability  growth  program  and  production  re¬ 
liability  assurance  testing  (PRAT)  in  No¬ 
vember  1987.  PRAT  and  the  quarterly 
reliability  award  fee  test  (RAFT)  has  dem¬ 
onstrated  a  MTBF  of  over  2000  hours 
compared  to  the  1250  hour  MTBF  require¬ 
ment  Delivery  of  the  LRIP  ground  radios 
began  in  January  1957  fur  FOT&E,  opera¬ 
tional  use  in  Korea,  and  other  uses.  De¬ 
lays  in  completion  of  PRAT  and  other 
first-article  tests  required  prior  to  delivery 
of  LRDP  radios  resulted  in  the  loss  of  pro¬ 
curement  funds  in  the  FY86  and  FY87 
budget  processes,  and  the  FY86  require¬ 
ment  for  a  Secretary  of  Defense  certifica¬ 
tion  of  need  to  continue  the  program. 

The  LRIP  radio  reliability  and  other 
problems  resulted  in  an  FY86  Army  sur¬ 
vey  of  available  industry  radios  and  later 
comparison  to  the  available  SINCGARS 
radio.  OTEA  conducted  an  assessment  of 
nine  NDI  candidate  radios  and  the  avail- 
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able  S1NCGARS  production  design  radios 
from  August  25  to  October  24,  1986,  at 
Fort  Riley  and  prepared  a  report  (May  7, 
1987).  The  SINCGARS  contractor  also 
conducted  exercises  with  soldiers  at  Fort 
Gordon,  Georgia.  According  to  the  Army, 
the  current  SINCGARS  production  design 
exhibited  the  highest  reliability  of  10  ra¬ 
dios  in  the  NDI  operational  assessment  at 
Fort  Riley.  The  Army  also  assessed  the 
SINCGARS  as  one  of  the  three  best  per¬ 
formers  of  the  ten  radios.  In  the  Army’s 
view,  unless  SINCGARS  requirements  are 
reduced,  a  major  development  effort 
would  be  required  to  make  any  of  the  NDI 
candidates  suitable  for  an  interim/replace¬ 
ment  VHF-FM  combat  net  radio. 

OT&E  ISSUES 

The  Army  was  advised  by  OSD  in  Decem¬ 
ber  1984  that  a  comprehensive  follow-on 
operational  test  and  evaluation  (FOT&E) 
of  production  radios  would  be  required 
prior  to  the  planned  award  of  the  original 
contract  Option  3  for  16,000  radios,  which 
was  defined  to  constitute  proceeding  be¬ 
yond  LRIP.  The  Army  was  also  directed 
to  discontinue  multi-year  procurement 
plans  and  to  submit  a  test  and  evaluation 
master  plan  (TEMP)  to  OSD  for  approval, 
including  reliability  and  built-in-test  (BIT) 
thresholds.  OSD  reviewed  the  program 
with  the  Army  in  December  1986,  and  an 
OSD  decision  memorandum  (February  12, 
1987)  requested  quick  resolution  of  the 
testing  issues  by  Army  submittal  of  the  ap¬ 
prover*  TEMP  by  March  15,  1987,  and  by 
Army  submittal  of  an  operational  test 
(OT)  plan  for  approval.  'The  Army  has 
prepared  various  versions  of  a  SINCGARS 
TEMP,  the  latest  dated  August  19,  1988, 
and  without  validation  of  the  threat  sec¬ 
tion.  To  date,  there  is  no  OSD-approved 
SINCGARS  TEMP. 

The  Army  has  restructured  the  original 
production  contract  to  minimize  produc¬ 
tion  of  the  LRIP  design  and  transfer  the 
new  ICOM  development  design  into  pro¬ 


duction  by  engineering  change  proposal 
(ECP)  applied  to  2000  of  8250  radios  pre¬ 
viously  ordered  on  Option  2  (LRIP),  over 
9000  of  16,000  radios  yet  to  be  ordered  on 
Option  3  (full-rate  production),  and  all 
16,000  radios  yet  to  be  ordered  on  Option 
4  (continuing  full-rate  production)  of  the 
original  production  contract.  The  Army 
has  also  awarded  a  second-source  con¬ 
tract  to  build  form,  fit,  and  function  inter¬ 
changeable  and  interoperable  versions 
(versus  build  to  print)  of  the  ICOM  radio. 
Both  sources  are  using  the  same  front 
panel  switches,  displays,  and  operating 
procedures  which  have  not  completed  de¬ 
velopment  by  the  first  development/pro¬ 
duction  contractor.  OT&E  of  the  ICOM 
system  has  not  been  conducted  to  support 
these  decisions. 

Interoperability  of  the  separately  devel¬ 
oped  SINCGARS-capable  systems  (SINC¬ 
GARS  LRIP  design,  SINCGARS  ICOM 
system  design,  second  source  SINCGARS 
ICOM  design,  Air  Force  airborne  HAVE 
SYNC  design,  and  Navy  developments) 
has  not  been  demonstrated,  nor  has 
NATO  interoperability.  Specific  testing  of 
the  Air  Force,  Navy,  and  NATO  inter¬ 
operability  has  not  been  included  in  any 
SINCGARS  TEMP  so  far  provided  for 
OSD  approval,  even  though  requested  by 
DOT&E. 

OT&E  ACTIVITY 

The  Follow-on  Operational  Test  and 
Evaluation  (FOT&E)  of  over  80  non- 
ICOM  SINCGARS  ground  radios  and  an 
Early  User  Test  and  Experimentation 
(EUT&E)  of  six  non-ICOM  SINCGARS 
airborne  radios  was  conducted  at  Fort  Sill, 
Oklahoma  from  April  11  to  May  10,  1988 
Army  reports  are  •,:.*) \  1  prepared  to 
support  the  plu...  d  January  3989  Defense 
Acquisition  Board  vOAB)  decision  on  Op¬ 
tion  3. 

A  Mutual  Interference  (MINT)  investi¬ 
gation  of  one  hundred  non-ICOM  ground 
radios  was  also  conducted  at  Fort  Sill  in 
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June  1988  following  FOT&E.  Army  re¬ 
ports  are  being  prepared  to  support  future 
MINT  predictions. 

Additional  field  operational  reliability 
testing  was  conducted  in  Korea  from  July 
23  to  September  30,  1988,  using  25  non- 
ICOM  ground  radios.  The  Army  report 
still  is  being  prepared. 

A  concept  was  initiated  to  conduct  a 
user  field  experiment  with  SINCGARS 
ICOM  advanced  developmental  radios  at 
Fort  Hood,  Texas.  TEXCOM  is  the  tester, 
OTEA  the  independent  evaluator,  and  the 
Marine  Corps  is  an  observer.  This  experi¬ 
ment  will  permit  observation  of  the  field 
interoperability  of  non-ICOM  with  ICOM, 
user  ease  of  operations,  and  ICOM  addi¬ 
tional  capability  features.  An  Army  report 
is  expected  to  support  the  planned  January 
1989  DAB  decision  on  option  3. 

OT&E  ASSESSMENT 

Laboratory  and  field  testing  results  dem¬ 
onstrate  significant  growth  in  non-ICOM 
ground  radio  hardware  reliability  above 
the  1250  hours  MTBF  goal.  Operational 
reliability  in  the  field  is  diminished  by  op¬ 
erator  error  due  to  complexity  of 
SINCGARS  radio  operations  to  establish, 
maintain,  and  change  network  communi¬ 
cations.  BIT  design  appears  inadequate 
and  ineffective. 

The  SINCGARS  ground  radios  opera¬ 
tions  and  performance  was  investigated  in 
various  threat  portrayals  during  FOT&E. 
DIA  is  reviewing  Army  threat  projections 
for  validation,  reflection  in  the  August  19, 
1988,  TEMP,  and  OSD  review  in  support 
of  the  planned  January  1989  DAB  deci¬ 
sions  on  the  Option  3  award. 

The  DOT&E  assessment  is  that  data 
from  realistic  user  operations  of  the  ICOM 
radios  plus  assessments  of  results  from 
non-ICOM  testing  in  1988  should  consti¬ 


tute  an  acceptable  level  of  evidence  to  pro¬ 
ceed  to  the  planned  January  1989  DAB  for 
decisions  on  Option  3  for  16,000  radios 
from  the  first  source.  The  Army  is  com¬ 
pleting  the  reports  on  this  data  from  the 
contractor  test,  FOT&E  of  the  ground 
non-ICOM,  EUT&E  of  the  airborne  non- 
ICOM,  MINT  investigations,  operational 
reliability  tests  of  the  non-ICOM  in  Korea, 
and  EUT&E  of  the  ground  ICOM,  all  on 
the  first-source  contractor  system  designs. 

The  immaturity  of  ICOM  designs,  the 
controlled  and  experimental  nature  of 
EUT&E,  the  need  for  additional  data  con¬ 
cerning  complexity  of  net  operations,  the 
continuing  investigations  of  various  im¬ 
pacts  on  range  and  quality  of  communica¬ 
tions,  and  the  continuing  requirement  to 
review  performance  against  current  DIA 
validated  threats,  require  an  initial  opera¬ 
tional  test  and  evaluation  (IOT&E)  of  both 
the  first-and  second-source  ICOM  radios 
prior  to  release  of  FY91  funds.  IOT&E  of 
production  representative  items  for  the 
newly  developed  ICOM  systems  should  be 
conducted  before  proceeding  beyond  LRIP 
with  the  system  designs.  IOT&E  of  the 
second  source  ICOM  will  be  required  to 
confirm  interoperability,  operational  effec¬ 
tiveness,  and  operational  suitability  of  the 
interchangeable  form,  fit,  function  design. 

SUMMARY 

Significant  improvements  to  SINC-GARS 
have  been  demonstrated  in  FY88.  Deci¬ 
sions  are  required  in  FY89  for  proceeding 
with  SINCGARS  production.  Final  deci¬ 
sions  for  release  of  FY89  funds  for  pro¬ 
ceeding  beyond  existing  first-source  Op¬ 
tion  2  LRIP  contract  orders  should  be 
preceded  by  Army  reports  on  FY88  testing 
of  non-ICOM  and  ICOM  radios,  an  OSD- 
approved  TEMP  for  future  testing,  and  a 
DOT&E  report  providing  an  independent 
assessment  of  the  adequacy  of  testing  and 
the  operational  effectiveness  and  opera¬ 
tional  suitability  of  the  systems  actually 
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tested.  Confirmation  of  multi-Service  and 
NATO  interoperability  is  required. 

Final  decisions  for  release  of  FY91 
funds  should  be  preceded  by  Army  reports 
on  IGT&E  of  both  the  first-and  second- 
source  ICOM  radios,  Service  reports  on 


operational  testing  of  multi-Service  inter¬ 
operability,  and  a  DOT&E  report  provid¬ 
ing  an  independent  assessment  of  the  ade¬ 
quacy  of  testing  and  the  operational 
effectiveness  and  operational  suitability  of 
the  systems  actually  tested. 


SINGLE  CHANNEL  GROUND 
AND  AIRBORNE  RADIO 
SYSTEM  (SINCGARS) 


III-43 


STINGER  REPROGRAMMABLE  MICRO  PROCESSOR  (RMP) 


SYSTEM  DESCRIPTION 


The  Stinger-RMP  guided  missile  system  is 
a  single-operator,  shoulder-fired  weapon 
system  with  an  all-aspect  engagement  ca¬ 
pability  against  low-altitude  observation 
and  attack  aircraft.  It  differs  from  the 
Stinger-Basic  weapon  system  only  in  the 
guidance  assembly  and  launcher  front 
window.  The  differences  from  Stinger- 
POST  (Passive  Optical  Seeker  Technique) 
are  that  the  guidance  and  Infrared 
Counter-Counter  Measures  functions  are 
reprogrammable  by  external  means.  The 
Stinger-RMP  weapon  round  consists  of  a 
guided  missile  round  and  a  separable 
gripstock.  It  is  also  intended  to  be  used 
with  the  FAADS  Pedestal  Mounted  Stinger 
system,  the  Army  Aviation  Air-to-Air 


Stinger,  and  the  shoulder-fired,  man-port¬ 
able  Stinger  described  above. 

BACKGROUND 

The  Stinger  system  has  gone  through  sev¬ 
eral  improvement  programs,  beginning 
with  Stinger  Basic  production  in  1978.  Im¬ 
mediately  following  production  of  the 
Stinger  Basic,  Development  Test  and 
Evaluation  (DT&E)  began  on  the  next  gen¬ 
eration  Stinger,  the  Stinger-POST.  This 
was  a  preplanned  product  improvement  to 
the  Stinger-Basic  seeker  head  assembly 
and  guidance  electronics  assembly  which 
significantly  increased  the  missile’s  capa¬ 
bility.  However,  production  in  FY83-84 
was  limited.  In  September  1984,  the  de¬ 
velopment  contract  was  awarded  for  the 
next  generation  missile,  the  Stinger-RMP 
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to  provide  a  capability  against  advanced 
threats.  Unique  to  the  RMP  is  the  capabil¬ 
ity  to  make  software  changes  as  the  threat 
evolves.  Limited  technical  testing  and  no 
operational  testing  was  done  on  this  sys¬ 
tem  prior  to  production  in  1985.  In  No¬ 
vember  1987,  the  Stinger-RMP  Production 
Verification  Test/Pilot  Lot  Test  program 
began.  Results  indicated  that  the  Stinger- 
RMP  had  some  technical  problems  and  re¬ 
quired  further  testing.  It  was  not  released 
for  deployment  pending  completion  of 
planned  additional  testing. 

OT&E  ISSUES 

In  early  1989  another  series  of  missile  fir¬ 
ing  tests  will  take  place  to  determine  if  the 
missile  improvements  have  been  made. 
This  office  reviewed  the  testing  program 
and  insisted  that  an  operational  baseline 
be  established  as  well  as  for  other  techni¬ 
cal  areas  verified  for  Stinger-RMP  before 


the  system  is  released  to  the  field.  Spe¬ 
cifically,  DOT&E  is  requiring  the  follow¬ 
ing  operational  conditions  be  present  dur¬ 
ing  the  next  series  of  tests:  (1)  advanced 
threat  countermeasures;  (2)  threat-repre¬ 
sentative  target  altitudes  and  profiles  with 
a  clutter  background;  (3)  a  correctly  char¬ 
acterized  “dirty”  battlefield,  and;  (4)  sol¬ 
diers  conducting  the  operational  firings. 

SUMMARY 

The  next  series  of  missile  firing  tests,  be¬ 
ginning  in  early  1989,  will  determine  if  the 
Stinger-RMP  has  overcome  its  technical 
difficulties  and  achieved  the  operational 
effectiveness  desired  of  the  system.  This 
office  will  approve  the  test  plan  only  if  it 
includes  the  operational  conditions  de¬ 
scribed  above.  We  will  monitor  the  test  to 
ensure  that  it  meets  the  requirements  as 
stated. 
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A-6E  INTRUDER 


SYSTEM  DESCRIPTION 

The  A-6E  Intruder,  the  only  Navy  and  Ma¬ 
rine  Corps  all-weather  attack  aircraft,  is  a 
long-range,  twin-engine,  carrier-based, 
medium  attack  aircraft  capable  of  very  ac¬ 
curate  navigation  and  delivery  of  nuclear 
and  nonnuclear  weapons  from  five  exter¬ 
nal  stores  stations.  Its  avionics  system  in¬ 
cludes  a  microminiaturized  digital  com¬ 
puter,  a  solid-state  weapon  release 
system,  a  single  integrated  track  and 
search  radar  and  a  carrier  airborne  inertial 
navigation  system  (CAINS).  An  added  ca¬ 
pability,  the  target  recognition  and  attack 
multisensor  (TRAM),  has  been  procured 
under  a  multiyear  production  contract 


since  FY76.  This  major  subsystem  in¬ 
cludes  an  infrared  sensor,  laser  ranger / 
designator,  and  laser  receiver.  It  provides 
the  capability  for  night  surveillance,  target 
identification  and  the  delivery  of  laser- 
guided  weapons.  The  A-6E  system/weap¬ 
ons  integration  program  (SWIP)  aircraft  is 
an  upgrade  of  the  A-6E  TRAM  aircraft.  It 
includes  an  updated  electronic  warfare 
(EW)  suite  (ALR-67  and  ALQ-126B),  an 
improved  weapons  management  and  con¬ 
trol  system  (the  avionics  interface  set 
(AIS))  for  an  increased  standoff  weapons 
capability,  a  high-speed  anti-radiation 
missile  (HARM)  command  launch  com¬ 
puter  (CLC),  and  a  new  operational  flight 
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program  (OFP),  E-240,  to  integrate  and 
manage  the  hardware  upgrades. 

BACKGROUND 

The  A-6E  prototype  aircraft  first  flew  in 
March  1970.  It  was  introduced  to  the  fleet 
in  December  1971  and  first  deployed  in 
September  1972.  The  first  full  TRAM  air¬ 
craft  was  delivered  in  September  1979, 
with  an  IOC  of  December  1979.  The 
A-6E  SWIP  achieved  IOC  with  the  deploy¬ 
ment  of  VA-75  in  August  1988. 

OT&E  ISSUES 

The  issues  to  be  addressed  during  A--6E 
SWIP  testing  include  evaluation  of  the  op¬ 
erational  effectiveness  and  suitability  of 
OFP  E-240,  the  new  avionics,  the  up¬ 
graded  EW  suite,  the  standoff  weapons  ca¬ 
pabilities,  and  the  effect  of  SWIP  on  air¬ 
craft  survivability.  The  testing  of  the 
aircraft’s  survivability  was  discussed  in  de¬ 
tail  by  DOT&E  and  OPTEVFOR  during 
the  OT-IIB  test  Man  briefing  and  approval 
process  (approved  October  26,  1987). 

OT&E  ASSESSMENT 

Operational  testing  (OT-IIA)  of  the  A-6E 
SWIP,  which  commenced  in  July  1987  and 
was  completed  in  November  1987,  was 
conducted  concurrently  with  TECHEVAL 
(DT-IIC).  Test  objectives  were  planned  to 
assess  the  weapons  delivery  accuracy 
(WDA)  for  unguided  weapons,  navigation 
accuracy,  effectiveness  of  the  EW  suite, 
and  A-6E  SWIP  integration  with  the 
HARM  weapon  system.  A-6E  SWIP 
OPEVAL  (OT-IIB)  began  in  November 
1987  and  was  completed  in  May  1988. 
Planned  test  objectives  were  the  A-6E 
SWIP  integration  with  the  Harpoon  1C, 
Laser  and  UR  Maverick  weapons  systems, 
the  validity  of  the  WDA  findings  from 
OT-IIA,  weapons  employment  envelopes 
and  their  impact  on  A-6E  SWIP  surviv¬ 
ability,  and  the  effect  of  various  counter¬ 
measures.  Both  OT-IIA  and  OT-IIB  ex¬ 


amined  the  suitability  issues  of  reliability, 
maintainability,  availability,  logistic  sup- 
portability,  technical  documentation,  com¬ 
patibility,  interoperability,  training,  human 
factors,  safety,  and  built-in  test  (BIT)  reli¬ 
ability. 

Testing  was  conducted  at  various 
ranges  in  California,  Nevada,  and  Florida. 
Carrier-based  operations  were  conducted 
while  embarked  in  USS  Carl  Vinson 
(CVN-70)  and  USS  Enterprise  (CVN-65). 
Test  personnel  included  aircrews  from 
VX-5  and  VA-75,  with  maintenance  per¬ 
sonnel  from  VX-5,  VA-75,  and  VA-145. 
Testing  consisted  of  327  sorties  and  561.5 
flight  hours,  with  20  types  of  ordnance 
bein  expended.  Limitations  to  test  in¬ 
cluded:  no  Laser  or  HR  Maverick  missiles 
were  fired;  not  all  ordnance  cleared  for 
carriage  and  release  was  available;  not  all 
modes  of  launch  for  the  ordnance  that  was 
available  were  tested;  the  types  of  threat 
simulators  available  for  HARM  testing 
were  limited;  the  limited  number  of  emit¬ 
ters  available  at  any  one  test  facility  pre¬ 
vented  an  evaluation  of  the  EW  suite’s  ca¬ 
pability  to  handle  maximum  signal 
density;  ground-based  jammers  were  not 
available;  EW  effectiveness  at  sea  could 
not  be  tested  due  to  the  nonavailability  of 
instrumented  sea-based  threats;  no  inter¬ 
mediate-level  maintenance;  supply  sup¬ 
port  system  was  not  at  full  maturation  - 
most  A-6E  SWIP  peculiar  hardware  items 
were  preproduction  and  had  to  be  pro¬ 
cured  from  the  contractor;  fleet-supported 
reprogrammability  was  not  tested-due  to 
lack  of  facilities  and  equipment. 

The  operational  effectiveness  test  ob¬ 
jectives  were  resolved  as  follows.  Weapons 
delivery  accuracy  (WDA):  Although  the 
A-6E  SWIP  met  the  circular  error  prob¬ 
able  (CEP)  threshold  requirements,  the 
aircraft’s  WDA  is  far  behind  current  gen¬ 
eration  aircraft.  Navigation  accuracy:  The 
A-6E  SWIP  met  all  drift-rate  threshold  re¬ 
quirements  for  the  different  type  align¬ 
ments  and  demonstrated  a  satisfactory 
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enroute  navigation  and  first  pass  attack  ca- 
ability.  Effectiveness  of  EW  suite:  The 
WIP  EW  suite  demonstrated  a  significant 
improvement  over  the  previous  A-6E  EW 
suite  (AUR-45D/50  and  ALQ-126A). 
[material  deleted]  HARM  weapon  system 
integration:  The  A-6E  SWIP  successfully 
launched  all  three  HARMs  in  the  three  dif¬ 
ferent  modes  of  employment  off  thee  dif¬ 
ferent  aircraft  stations.  Maverick  weapon 
system  integration:  This  test  objective  was 
not  resolved  (see  limitations  to  test).  Har¬ 
poon  1C  weapon  system  integration :  The 
A-6E  SWBP  successfully  completed  a  Har¬ 
poon  captive-carry  program,  followed  by 
a  successful  launch  of  a  Harpoon  Block 
1C  fired  in  the  range  and  bearing  launch 
mode  using  the  waypoint  capability.  Sur¬ 
vivability:  The  incorporation  of  the  new 
EW  suite,  HARM,  and  Harpoon  increased 
the  A-6E  SWIP  aircraft’s  standoff  detec¬ 
tion  and  weapons  employment  ranges  over 
the  A-6E  TRAM,  which  improved  the  air¬ 
craft’s  survivability.  However,  the  follow¬ 
ing  total  system  deficiencies  were  noted 
during  survivability  testing.  (In  some 
cases  a  particular  subsystem  did  not  meet 
the  test  criteria  versus  a  specific  threat, 
whereas  the  A-6E  SWIP  was  still  demon¬ 
strated  to  be  survivable  against  that 
threat.)  Effect  of  countermeasures:  This 
test  objective  was  not  resolved  (see  limita¬ 
tions  to  test). 


The  operational  suitability  test  objec¬ 
tives  were  resolved  as  follows:  Reliability, 
maintainability,  availability  (RMA)  of  the 
A-6E  SWIP  avionics  system:  All  avionics 
interface  set  (AIS)  RMA  criterion  were 
met.  The  maintainability  of  the  ALR-67 
and  ALQ-126B  did  not  meet  threshold  re¬ 


quirements.  Logistic  supportability:  The 
technical  logistics  data  and  squadron 
maintenance  planning,  packaging,  han¬ 
dling,  storage  and  transportation  of  the 
A-6E  SWIP  system  were  assessed  as  ade¬ 
quate.  Minor  disrepancies  were  associ¬ 
ated  with  a  lack  of  adequate  numbers  of 
memory  loader  verifiers  for  the  OFP  and 
the  high  failure  rates  of  the  AWM-92  test 
set  required  to  load  the  HARM  and  Mav¬ 
erick  missiles.  Technical  documentation: 
One  minor  documentation  discrepancy 
was  discovered.  Training:  The  planned 
training  for  aircrew  and  maintenance  per¬ 
sonnel  was  adequate,  with  no  deficiencies 
noted.  Human  factors:  The  location  of  the 
integrated  missile  panel  (IMP)  on  the 
cockpit  center  console  was  judged  to  be 
unsatisfactory  because  it  created  a  ten¬ 
dency  for  either  one  or  both  crewmembers 
to  be  heads  down  in  the  cockpit  for  pro¬ 
longed  periods  of  time.  Safety:  The  ex¬ 
cessive  amount  of  time  required  to  inter¬ 
face  with  the  IMP  can  lead  to  unsafe 
situations,  in  particular  at  low  altitude  or 
night.  BIT:  The  AIS  BIT  provided  accu¬ 
rate  fault  detection  and  isolation,  meeting 
all  threshold  requirements. 

SUMMARY 

The  results  of  testing  indicated  that  the 
A-6E  SWIP  was  potentially  operationally 
effective  and  potentially  operationally  suit¬ 
able.  The  major  areas  identified  for  cor¬ 
rection  and  verification  through  additional 
OT&E  were:  (1)  conduct  OT&E  of  the 
A-6E  SWIP  with  Laser  and  HR  Maverick 
missiles;  and  (2)  relocate  the  IMP  or  rede¬ 
sign  the  information  display  format  to 
lessen  the  amount  of  time  required  for 
aircrew  to  be  head-down  in  the  cockpit. 
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SYSTEM  DESCRIP110N 

The  High  Speed  Anti-Radiation  Missile 
(HARM)  is  an  air-to-surface  missile  de¬ 
signed  to  suppress  or  destroy  land-  and 
sea-based  radars  which  direct  enemy  air 
defense  systems.  HARM  was  a  design 
evolution  of  the  existing  ARM  weapons 
(Shrike  and  Standard  ARM)  and  replaces 
them  in  the  Navy  inventory.  HARM  has 
been  integrated  and  successfully  deployed 
on  the  A-7E,  F/A-18,  and  EA-6B  aircraft. 
It  is  being  integrated  into  the  Navy’s  A-6E 
aircraft  and  in  the  future  will  be  integrated 
on  the  F--14.  Performance  characteristics 
include:  high  speed,  large  footprint,  high 
sensitivity  to  weak  signals,  and  software 
adaptability  to  the  constantly  changing 
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threat.  HARM  weighs  807  pounds.  It  is 
164  inches  long  and  10  inches  in  diameter. 

BACKGROUND 

Joint  US  Navy  (lead  Service)/US  Air  Force 
initial  operational  testing  of  HARM  began 
in  1979  and  resulted  in  full  production  and 
approval  for  HARM’S  introduction  into  the 
fleet  on  A-7E  aircraft  in  April  1983.  Out¬ 
standing  deficiencies  have  been  addressed 
through  a  missile  performance  upgrade 
program.  In  June-July  1984,  the  stand 
alone  HARM  weapon  system  was  assessed 
as  being  potentially  operationally  effective 
when  employed  on  the  F/A-18  aircraft. 
During  the  period  December  1984-JuIy 
1985,  follow-on  operational  test  and 
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evaluation  (FOT&E)  of  the  HARM  inte¬ 
grated  electronic  warfare  (EW)  suite  on 
the  F/A-18  was  conducted,  and  the 
HARM  was  approved  for  operation  on  the 
F/A-18.  Two  OT  firings  were  conducted 
in  FY86  in  conjunction  with  an  interim 
EA-6B  HARM.  The  firings  were  success¬ 
ful  in  all  phases  of  EA-6B  integration  and 
the  EA-6B/HARM  was  approved  for  lim¬ 
ited  fleet  introduction  in  August  1986. 
Current  integration  efforts  will  provide  full 
HARM  capability  for  the  EA-6B,  followed 
by  the  A-6E.  The  version  of  HARM  cur¬ 
rently  in  the  fleet  is  Block  EL  The  Block  in 
version,  with  improved  software,  is  pres¬ 
ently  in  developmental  test.  A  follow-on 
version  of  HARM  will  be  a  software/hard- 
warc  change  called  Block  IV.  Block  IV 
will  be  competed  with  a  second  source 
Low  Cost  Seeker  (LCS)  version  of  HARM. 

OT&E  ISSUES 

Critical  operational  issues  include  detec¬ 
tion  range,  accuracy  (lethal  range), 
reprogrammability,  survivability  of  shoot¬ 
er,  the  launch  aircraft;  susceptibility  to 
countermeasures,  reliability,  maintainabil¬ 
ity,  availability,  and  training. 


OT&E  ACTIVITY 

The  Navy  conducted  operational  testing  on 
the  Biock  II  version  during  FY87  "and 
FY88.  The  final  results,  available  in  mid- 
FY88,  supported  continuing  fleet  deploy¬ 
ment  and  demonstrated  the  missile  to  be 
operationally  effective  and  suitable.  Defi¬ 
ciencies  noted  were  combined  with  the  Air 
Force’s  OT&E  results  and  resulted  in  the 
Block  m  software  upgrade.  OT&E  activity 
on  Block  HI  will  begin  in  early  FY89. 
OT&E  on  the  Block  IV  and  LCS  versions 
is  projected  for  FY90.  DOT&E  reviewed 
ana  approved  the  Block  IH  Test  and  Evalu¬ 
ation  Master  Plan  (TEMP)  and  the  OT&E 
test  plan  in  November  1988. 

SUMMARY 

Joint  operational  testing  has  been  under 
way  since  1979.  Although  each  service  has 
slightly  different  requirements,  the  critical 
review  and  recommended  changes  by  the 
two  separate  tests  and  the  resultant  system 
changes  are  strengthening  the  system 
overall.  Changes  to  the  system  in  Blocks 
III  and  IV  and  the  LCS  should  provide  the 
capabilities  necessary  for  today  and  for 
the  future.  Well-planned  tests  are  sched¬ 
uled  for  each  of  the  new  versions. 
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SYSTEM  DESCRIPTION 

The  AIM-54  Phoenix  is  an  all-weather, 
long-range,  conventional-warhead  air-to- 
air  missile  which  uses  semiactive  mid¬ 
course  guidance  and  active  terminal  guid¬ 
ance.  Six  Phoenix  missiles  can  be  carried 
aboard  the  F-14A/A+/D,  which  can  per¬ 
form  nearly  simultaneous  missile  launches 
against  six  taigets  in  both  clear  and  jam¬ 
ming  environments.  The  AIM-54C  incor¬ 
porates  upgrades  of  selected  components 
of  the  AIM-54A.  It  is  designed  to  im¬ 
prove  missile  lethality,  stream-raid  dis¬ 
crimination,  ECCM  performance,  high- 
and  low-altitude  performance,  reliability, 
maintainability  and  availability.  Additional 
changes  have  been  made  to  the  AIM-54C 
through  an  engineering  change  proposal 


(ECP-82)  to  further  improve  its  ECCM 
capabilities  and  permit  employment  on  the 
F-14D  in  a  sealed/diy  (liquid  coolant  no 
longer  required)  configuration.  It  can  still 
be  carried  on  the  F-14A  in  the  “wet”  con¬ 
figuration  (i.e.,  the  aircraft  supplies  cool¬ 
ant  for  heating  or  cooling  the  missile). 
The  AJM-54C  with  ECP-82  is  sometimes 
referred  to  as  the  AIM-54C+. 

BACKGROUND 

The  AIM-54C  entered  development  in 
1976  in  response  to  an  increasingly  sophis¬ 
ticated  and  capable  threat.  (AIM-54A 
production  ceased  in  1979.)  The  AIM-54C 
completed  operational  evaluation  (OPE- 
VAL)  in  August  1984  and  initial  opera¬ 
tional  capability'  (IOC)  was  declared  in 
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December  1986.  The  first  phase  of  fol¬ 
low-on  operational  test  and  evaluation 
(FOT&E),  OT-DIA,  was  completed  in 
FY86  and  was  described  in  our  FY86  An¬ 
nual  Report.  OT-DIB  was  divided  into  two 
phases.  OT-IHB1  tested  the  AIM-54C 
(ECP-82)  with  2.1  firmware.  OT-IIIB2 
tested  the  AIM-54C  (ECP-82)  with  3.0 
firmware. 

The  AIM-54  was  built  under  a  sole- 
source  contract  with  Hughes  Aircraft 
Company  until  1986,  when  Raytheon  be¬ 
came  a  second  source.  A  three-phase 
qualification  test  and  evaluation  (QT&E) 
for  the  Raytheon  missiles  is  planned  utiliz¬ 
ing  FY86  (Phase  I)  “learn”  missiles,  FY87 
(Phase  II)  “validation”  missiles,  and  FY88 
(Phase  ID)  “directed-buy”  missiles.  Ray¬ 
theon  will  bid  on  the  FY89  production 
missiles.  The  only  missile  which  has  un¬ 
dergone  OT&E  to  date  is  the  Hughes  mis¬ 
sile. 

OT&E  ISSUES 

The  purpose  of  OT-EUBl  and  OT-DEB2 
was  to  determine  the  operational  effective¬ 
ness  and  operational  suitability  of  the 
AIM-54C  with  ECP-82.  Additional  items 
to  be  addressed  included  correction  of  the 
design  and  production  deficiencies  associ¬ 
ated  with  the  FSU-10/A  safety  and  arming 
device,  target  detecting  device  (TDD)  per¬ 
formance,  and  missile  modifications  not 
tested  in  OT-DIA.  The  critical  operational 
issues  were  (1)  operational  capabilities, 
(2)  operating  environment  effects,  (3)  vul¬ 
nerability,  (4)  programmability,  (5) 
ECCM/sealed  missile,  (6)  F-14/AWG-9 
support,  (7)  reliability,  (8)  maintainability, 
(9)  logistic  supportability,  (10)  compatibil¬ 
ity,  (11)  interoperability,  (12)  training, 
(13)  documentation,  (14)  human  factors, 
and  (15)  safety. 

The  TEMP  and  OT-HIB1/2  test  plan 
are  very  detailed  and  extensive.  In  par¬ 
ticular,  the  scope  and  intensity  of  planned 
ECM  testing  during  OT-DIB  is  impressive. 


Areas  of  DOT&E  interest  identified  in  the 
TEMP  approval  letter  are  OT&E  of  sec¬ 
ond-source  missiles  and  OT&E  in  the 
presence  of  electromagnetic  interference 
(EMI). 

OT&E  ACTIVITY 

OT-BIB2  began  in  May  1988  and  was 
completed  in  December  1988.  The 
DOT&E  assessment  of  OT-DIB2  will  be 
included  in  our  next  Annual  Report.  A 
member  of  the  DOT&E  staff  has  been 
closely  involved  in  the  operational  testing 
of  the  AIM-54C  during  OT-DIB1  and  B2, 
observing  the  missile-launch  profiles  and 
reviewing  the  test  data. 

OT&E  ASSESSMENT 

OT-DIB1  of  production  AIM~54Cs  with 
ECP-82  began  in  April  1987  and  was 
completed  in  July  1988.  Testing  was  con¬ 
ducted  in  California  at  the  Pacific  Missile 
Test  Center,  Point  Mugu,  and  Naval 
Weapons  Center,  China  Lake,  test  ranges. 

The  live-fire  missions  and  captive- 
data  flights  in  OT-IDBl  exercised  the 
AIM-54C  and  F-14A  weapon  system. 

The  major  results  of  the  critical  opera¬ 
tional  issues  are  discussed  below.  Due  to 
the  small  number  of  missiles  launched 
during  OT-IDBl,  the  live-lire  test  results 
obtained  during  OT-DIA  are  referenced 
here.  The  AIM-54C  missiles  tested  dur¬ 
ing  OT-IDBl  and  OT-DIA  contained  the 
same  2.1  firmware  logic  and  blast  frag¬ 
mentation  warhead.  However,  the  OT- 
DIA  AIM-54C  did  not  include  ECP-82, 
and  the  target  detecting  device  (TDD)  was 
revised  from  7.0  firmware  in  OT-DIA  to 
7.3  firmware  in  OT-IDBl. 

Operating  Environment  Effects.  The  mis¬ 
sile  was  tested  in  OT-IDBl  and  OT-DIA  in 
a  variety  of  environments  with  no  discrep¬ 
ancies  noted. 
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F-14/AWG-9  Support.  The  F-14/ 
AWG-9  generally  provided  adequate  sup¬ 
port  of  the  AIM-54C. 

Maintainability.  The  AIM-54C  demon¬ 
strated  direct  maintenance  man-hours  per 
flight  hour  (DMMH/FH)  was  0.4  hours 
(no  criterion). 

Logistic  Supportability.  The  AIM-  54C 
logistic  support  was  adequate. 

Interoperability.  The  AIM-54  C  with 
ECP-82  was  interoperable  with  its  operat¬ 
ing  environment. 

Training.  The  aircrew  mission  trainers 
(simulators)  and  maintenance  personnel 
training  were  adequate. 


Documentation.  The  AIM-54C  documen¬ 
tation  was  unsatisfactory  due  to  deficien¬ 
cies  in  the  Conventional  Weapons  Check¬ 
list  for  the  AIM-54  and  F-14.  In  addition, 
the  aircrew  could  not  identify  missile  firm¬ 
ware  and  hardware  during  prefli^ht  in¬ 
spections  without  the  use  of  missile  log 
cards.  This  is  important  because  the  firm¬ 
ware  and  hardware  modifications  effect 
tactical  employment. 

Human  Factors  and  Safety.  No  def- 
ciencies  were  noted. 

SUMMARY 

We  will  continue  our  close  observation  of 
Phoenix  operational  testing. 
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SYSTEM  DESCRIPTION 

The  SH-60F  provides  a  carrier  battle 
group  with  quick  reaction  inner-zone  anti¬ 
submarine  warfare  (ASW)  protection  (up 
to  50  nautical  miles)  and  secondary  mis¬ 
sions  of  search  and  rescue,  logistics  sup¬ 
port,  medical  evaluation,  and  chaff 
launching.  It  replaces  the  SH-3  helicopter. 
The  SH-60F  is  a  derivative  of  the  SH-60B 
(LAMPS  Mk  IE)  helicopter.  It  uses  the 
SH-60B  airframe  and  drive  train  and  re¬ 
places  mission  avionics  designed  for 
outer-zone  ASW  with  those  designed  for 
inner-zone  ASW.  This  includes  the  addi¬ 
tion  of  the  AQS-13F  active  dipping  sonar, 
which  operates  deeper,  has  a  greater 


source  level,  a  higher  figure  of  merit 
(FOM),  and  a  faster  reeling  machine  than 
its  predecessor.  The  combination  of 
greater  depth  and  higher  FOM  increases 
the  average  area  searched  per  dip.  A  new 
avionics  architecture,  based  on  the  exist¬ 
ing  ASN-123  mission  computer  and  a  data 
bus,  has  been  developed  for  the  SH-60F. 
Automatic  Flight  Control  System  (AFCS) 
modifications  have  been  incorporated  to 
tailor  the  automatic  approach,  departure 
and  hover  capabilities  to  inner-zone  mis¬ 
sion  requirements.  An  internal  auxiliary 
fuel  system  has  given  the  SH-60F  addi¬ 
tional  endurance,  and  a  third  weapons  sta¬ 
tion  has  been  added  on  a  port  side  stub 


AIRCRAFT  CARRIER 
INNER-ZONE  ASW 
HELICOPTER  (SH-60F) 


IV- 11 


NAVY 


wing  so  that  two  Mk  50  torpedoes  can  be 
earned  along  with  an  external  fuel  tank. 

BACKGROUND 

The  SH-60F  was  approved  as  a  new  start 
in  FY82  and  entered  full-scale  engineer¬ 
ing  development  (FSED)  in  February 
1985.  The  AQS-13F  sonar  initially  under¬ 
went  separate  development  as  an  improve¬ 
ment  to  the  existing  AQS-13E  sonar  and 
has  been  converted  to  SH-60F  equipment 
furnished  by  the  contractor  for  completion 
of  development.  Initial  operational  test 
and  evaluation  (IOT&E)  was  conducted  in 
1986  on  a  YSH-60B .  (prototype  for  the 
SH-60F).  The  system  was  found  to  be  po¬ 
tentially  operationally  effective  and  suit¬ 
able. 

OT&E  ISSUES 

Operational  issues  addressed  furing  FY88 
operational  testing  included  determination 
of  SH-60F  capability  to  detect,  classify,  lo¬ 
calize,  and  attack  threat-representative 
submarines;  determination  of  the  SH-60F 
capability  to  perform  other  missions;  as¬ 
sessment  of  sonobuoy  employment  capa¬ 
bility;  and  assessment  of  mission  endur¬ 
ance.  Operational  suitability  issues 
included  determination  of  reliability, 
maintainability,  and  availability  and  as¬ 
sessment  of  logistic  supportability,  com¬ 
patibility,  interoperability,  training,  human 
factors,  safety,  and  technical  documenta¬ 
tion. 

OT&E  ACTIVITY 

Operational  testing  was  conducted  from 
November  1987  through  January  1988. 
This  included  combined  developmental/ 
operational  testing  at  the  Atlantic  Under¬ 
sea  Test  and  Evaluation  Center  (AUTEC), 
Andros  Island,  Bahamas  underwater 
range.  Subsequent  testing  included  an  op¬ 
erational  evaluation  (OPEVAL),  with  op¬ 
erations  conducted  aboard  two  aircraft 
carriers  and  ashore  at  the  Naval  Air  Sta¬ 


tion,  Patuxent  River,  Maryland.  A 
DOT&E  staff  member  observed  the  opera¬ 
tional  testing  at  AUTEC. 

OT&E  ASSESSMENT 

Operational  scenarios  were  conducted 
against  simulated  threat  submarines  at¬ 
tempting  to  attack  either  a  simulated  or  an 
actual  carrier  battle  group.  Target  subma¬ 
rines  were  allowed  to  use  full  attack  and 
evasion  tactics.  Achievement  of  attack 
criteria  by  the  SH-60F  on  the  submarine 
was  verified  by  reconstruction.  In  addi¬ 
tion,  exercise  Mk  46  torpedoes  were 
launched  during  testing  at  the  AUTEC 
range. 

The  SH-60F  demonstrated  capability  to 
conduct  ASW  operations  during  day, 
night,  and  instrument  meteorological  con¬ 
ditions  employing  the  AQS-13F  active  dip¬ 
ping  sonar.  The  AQS-13F  dipping  sonar 
demonstrated  active  and  passive  detection 
ranges  in  excess  of  the  current  fleet  equip¬ 
ment  capability.  Mission  endurance  re¬ 
quirements  were  satisfactorily  demon¬ 
strated,  as  were  some  of  the  secondary 
missions  (plane  guard,  medical  evacu¬ 
ation,  and  limited  logistics  support). 

With  regard  to  operational  suitability, 
the  SH-60F  met  one  of  its  four  reliability 
criteria.  Three  of  five  maintainability  cri¬ 
teria  were  met.  Compatibility  deficiencies 
identified  included  unreliable  automatic 
fuel  management,  limitations  on  required 
inspections,  and  slow  and  unreliable  auto¬ 
matic  main  rotor  blade  folding  and  system 
resets  caused  by  electrical  system  opera¬ 
tion.  Interoperability  deficiencies  were 
identified  in  the  areas  of  communications, 
acoustic  control  and  display  and  automatic 
preset  of  torpedoes.  The  most  significant 
of  the  human  factors  deficiencies  noted 
was  cumbersome  operation  of  the  central¬ 
ized  management  system  control  display 
unit.  Deficiencies  were  noted  in  the  logis¬ 
tics  documentation  as  well  as  in  the  docu¬ 
mentation  used  during  test  operations. 
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The  training  syllabus  for  fleet  training  had 
not  been  implemented. 

SUMMARY 

Results  of  the  FY88  testing  presented  here 
were  reported  to  the  Secretary  of  Defense 
and  Congress  in  the  DOT&E’s  April  1, 
1988,  “Report  on  the  Operational  Test  and 
Evaluation  of  the  CV  Inner-Zone  ASW 
Helicopter  SH-60F”  which  is  required  be¬ 
fore  the  decision  to  proceed  beyond  low- 
rate  initial  production  (LRIP).  In  that  re¬ 
port  we  concluded  that  operational  testing 
of  the  SH-60F  was  conducted  in  an  opera¬ 
tionally  realistic  manner,  that  it  addressed 
most  of  the  critical  operational  issues,  and 
that  it  was  considered  adequate  to  support 
a  beyond-LRIP  decision.  We  also  con¬ 


cluded  that  operational  testing  results  indi¬ 
cated  that  the  SH-60F  had  demonstrated 
operational  effectiveness  in  its  primary 
mission  of  ASW.  Secondary  missions, 
with  the  exception  of  antiair  warfare  and 
command  control  and  communications 
were  also  satisfactorily  demon-  strated. 
Although  operational  suitability  was  defi¬ 
cient  in  the  areas  of  reliability,  compatibil¬ 
ity,  interoperability  and  human  factors, 
the  nature  of  these  deficiencies  indicated 
that  they  can  be  corrected  in  the  produc¬ 
tion  aircraft.  Finally,  we  concluded  that 
the  decision  to  proceed  beyond  LRIP  of 
the  SH-60F  was  low  risk.  Follow-on 
OT&E  of  the  SH-60F  is  scheduled  for 
FY89  to  verify  that  the  deficiencies  noted 
during  OPEVAL  have  been  corrected. 


AIRCRAFT  CARRIER 
INNER-ZONE  ASW 
HELICOPTER  (SH-60F) 
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SYSTEM  DESCRIPTION 

The  AN/SQS  53C  is  a  long-range,  multi- 
mode  search  sonar  designed  to  detect, 
classify,  localize  and  track  submarines  ac¬ 
tively  and  passively.  The  sonar  is  de¬ 
signed  to  provide  performance  and  oper¬ 
ability  improvements  over  the  AN/SQS 
53A/B  sonars,  as  well  as  to  provide  a  ma¬ 
jor  reduction  in  electronic  space  and 
weight.  The  AN/SQS  53C  was  developed 
to  equip  the  DDG-51  class  and  upgrade 
the  AN/SQS  53A/B  sonars  installed  in 
DD-963,  DD-993  and  CG-47  class  ships. 

The  AN/SQS  53C  sonar  consists  of  a 
cylindrical  array  formed  from  576  broad¬ 
band  transducer  elements.  The  sonar’s 
transmitter  consists  of  a  power  supply,  £ 


programmable  time  delay  beamformer 
and  576  transmit  modules.  The  active  re¬ 
ceiver  contains  the  active  signal  condition¬ 
ing,  beamforming  and  processing  func¬ 
tions  for  variable  depression  (VD), 
surface  duct  (SD),  and  track  modes  of  op¬ 
eration.  The  passive  receiver  contains  the 
signal  conditioning,  beamforming  and  sig¬ 
nal  processing  for  passive  broadband 
(PBB),  passive  narrowband  (PNB),  and  de¬ 
modulated  noise  (DEMON)  operation. 

BACKGROUND 

The  AN/SQS  53C  is  the  latest  result  of  an 
evolutionary  process  in  sonar  develop¬ 
ment.  The  AN/SQS  26  sonar  was  the  Na¬ 
vy’s  first  production  high-power,  low-fre¬ 
quency,  bow-mounted  sonar  designed  to 
exploit  the  convergence  zone  and  bottom 
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bounce  sound  paths.  One  of  several  modi¬ 
fications  of  this  sonar  is  installed  on  many 
of  the  older  Navy  surface  combatants. 
The  Surface  Ship  Sonar  Modernization 
Program  was  initiated  in  FY  74.  In  1978, 
the  program  was  restructured  as  a  multi¬ 
phase  program.  The  initial  phase  con¬ 
sisted  of  improvements  to  the  AN/SQS 
26C  sonar  in  both  its  passive  and  active 
capability.  The  AN/SQS  53A  sonar  is 
similar  to  the  AN/SQS  53A  sonar  is  simi¬ 
lar  to  the  AN/SQS  26CX,  except  that  it 
contains  a  digital  interface  with  its  anti¬ 
submarine  warfare  (ASW)  fire  control  sys¬ 
tem.  The  next  phase  resulted  in  the  AN/ 
SQS  53B,  which  replaced  the  analog 
controls  and  displays  of  the  AN/SQS  53A 
with  digital  Navy  standard  building  block 
components.  The  AN/SQS  53C  builds  on 
the  AN/SQS  53B  conversion  to  digital  by 
replacing  the  remaining  1960s  technology 
with  modem  digital  components,  including 
the  AN/UYK  44  Computer.  Both  the  AN/ 
SQS  53B  and  53C  systems  were  designed 
to  interface  with  the  AN/SQR  19  Towed 
Array,  the  AN/SQQ  28  LAMPS  Mk  m 
shipboard  processor  and  the  Mk  116  ASW 
Fire  Control  System,  as  a  component  of 
the  AN/SQQ  89  ASW  Combat  System. 

Initial  Operational  Test  and  Evaluation 
(IOT&E)  of  the  AN/SQS  53C  sonar  was 
conducted  in  two  phases  using  an  engi¬ 
neering  development  model  installed  in 
USS  Stump  (DD-978).  The  IOT&E  of  the 
AN/SQS  53C  was  done  with  the  sonar  in  a 
stand  alone  configuration.  Follow-on  op¬ 
erational  test  and  evaluation  will  be  con¬ 
ducted  with  the  AN/SQS  53C  as  an  inte¬ 
grated  component  of  an  AN/SQQ  89 
system. 

OT&E  ISSUES 

The  primary  operational  effectiveness  is¬ 
sues  addressed  in  the  IOT&E  on  the  AN/ 
SQS  53C  include:  the  capability  of  the 
sonar  to  detect,  localize  and  track  threat 
targets;  the  capability  of  the  ASW  fire 


control  system  to  support  contact  manage¬ 
ment  using  the  sonar  input;  and  the  ability 
of  the  sonar  to  operate  in  shallow  water. 
The  testing  will  also  address  the  full  range 
of  operational  suitability  issues  including: 
reliability,  maintainability,  availability,  in¬ 
teroperability,  logistics  supportability  and 
documentation. 

ASSESSMENT 

In  October  1987,  the  first  phase  (OT-IIA) 
of  IOT&E  was  conducted  in  the  Western 
Atlantic  Fleet  operating  area  in  accor¬ 
dance  with  a  test  plan  approved  by  the 
DOT&E.  The  test  consisted  of  four  days 
of  operations  against  USS  Narwhal 
(SSN-671)  in  which  a  total  of  13  screen¬ 
ing,  datum  search  and  pouncer  scenarios 
were  conducted.  The  testing  was  limited 
by  the  fact  that  the  test  area  was  represen¬ 
tative  of  only  one  of  the  intended  opera¬ 
tional  environments.  Testing  was  also  lim¬ 
ited  because  the  software  configuration  in 
the  USS  Stump  was  not  fully  representa¬ 
tive  of  that  planned  for  production  units 
and  the  capability  of  the  sonar  to  support 
placement  of  own-ship  weapons  could  not 
be  assessed  due  to  the  inaccuracy  of  sce¬ 
nario  reconstruction.  The  testing  was  not 
conducted  on  an  instrumented  range. 

The  Navy’s  independent  operational 
test  agent,  Commander,  Operational  Test 
and  Evaluation  Force  (COMOPTEVFOR) 
concluded  that  the  AN/SQS  53C  was  po¬ 
tentially  operationally  effective  and  poten¬ 
tially  operationally  suitable.  This  testing 
supported  a  recommendation  for  limited 
production  after  correction  of  software  re¬ 
liability  problems  and  provisions  were  es¬ 
tablished  for  an  adequate  tactical  employ¬ 
ment  doctrine. 

The  second  phase  of  IOT&E  (OT-IIB, 
OPEVAL)  was  conducted  from  January 
through  August  1988  in  accordance  with  a 
test  plan  approved  by  the  DOT&E.  The 
results  of  this  testing  are  still  being  ana- 
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lyzed  and  will  be  reported  in  the  FY89 
DOT&E  Annual  Report. 

SUMMARY 

In  our  view,  the  first  phase  of  IOT&E  dem¬ 
onstrated  that  the  AN/SQS  53C  sonar  has 
the  potential  to  be  operationally  effective 
and  operationally  suitable. 
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SYSTEM  DESCRIPTION 

The  Arleigh  Burke  class  multi-mission 
guided  missile  destroyer,  DDG-  51,  is 
planned  to  replace  existing  guided  missile 
destroyers  in  the  early  1990s.  It  is  de¬ 
signed  to  carry  out  offensive  and  defensive 
operations  as  a  unit  in  carrier  battle 
groups  and  surface  action  groups,  or  as 
the  lead  combatant  in  support  of  replen¬ 
ishment  and  amphibious  groups.  With 
two  Mk-41  vertical  launch  systems, 
DDG-51  will  be  armed  with  a  mix  of  90 
missiles  which  can  be  varied  to  support 
any  of  its  specific  missions. 

The  DDG-51  area  defense  antiair  warfare 
(AAW)  capability  is  provided  by  the 
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AEGIS  Weapon  System  (AWS),  which  in¬ 
cludes  the  AN/SPY-ID  radar  and  the  ver¬ 
tically  launched  SM-2  surface-to-air  mis¬ 
sile.  For  antisubmarine  warfare  (ASW) 
DDG-51  will  use  the  SQQ-89  surface 
ASW  Combat  System  employing  hull  and 
towed  array  sonars,  the  LAMPS  Mk  IH 
ASW  helicopter,  a  vertically  launched 
ASW  standoff  weapon  and  over-the-side 
torpedoes.  DDG-51  will  also  employ 
TOMAHAWK  and  HARPOON  missiles, 
and  the  5  inch/54  gun  for  antisurface  and 
strike  warfare  missions.  The  DDG-51 
AEGIS  Combat  System  is  the  integration 
of  the  AWS,  the  SQQ-89  ASW  Combat 
System,  and  the  ship’s  antisurface  and 
strike  warfare  systems.  The  DDG-51  will 
use  a  CG-47  type  propulsion  system  to 
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provide  a  maximum  speed  of  at  least  30 
knots. 

The  AN/SPY- ID  is  the  multifunction, 
phased-array,  three-dimensional  (range, 
altitude  and  bearing)  radar  system  which 
supports  the  Mk-7  Mod  6  AWS  in 
DDG-51  class  ships.  Radar  beams  radiate 
from  the  four  arrays  of  its  antenna  system 
to  support  the  radar  functions  of  search, 
track,  and  missile  midcourse  guidance. 
The  AN/SPY-iD  is  a  variant  of  the  AN/ 
SPY-1A  and  AN/SPY-1B  radars  systems 
on  TICONDEROGA  (CG-47)  class  cruis¬ 
ers,  tailored  for  employment  on  a  destroy¬ 
er-sized  ship.  The  system  initiates  auto¬ 
matic  detection  and  tracking  of  air  and 
surface  targets. 

BACKGROUND 

The  DDG-51  class  ship  completed  con¬ 
tract  design  in  FY84,  and  the  shipbuilding 
contract  for  the  first  ship  of  the  class  was 
awarded  in  FY85.  The  Navy’s  decision  to 
procure  additional  ships  of  the  DDG-51 
class  was  based  on  several  considerations. 
These  considerations  included  the  in-serv¬ 
ice  experience  and  operational  test  results 
of  those  systems  planned  for  DDG-51 
which  were  already  in  service  or  had  pre¬ 
viously  undergone  operational  testing  on 
other  platforms,  and  the  operational  test 
results  of  the  DDG-51  unique  AEGIS 
Weapon  System  and  Combat  System  con¬ 
ducted  during  FY86.  In  accordance  with 
10  U.S.C.  138,  the  decision  to  proceed  be¬ 
yond  low-rate  initial  production  (LREP) 
was  preceded  by  a  DOT&E  report  to  the 
Secretary  of  Defense  and  Congress.  In 
September  1988,  OT&E  was  conducted  on 
the  DDG-  51  AEGIS  Combat  System  at 
the  Combat  System  Engineering  Develop¬ 
ment  Site  (CSEDS)  at  Moorestown,  New 
Jersey. 

The  AN/SPY- ID  (for  DDG-51  class 
ships)  and  the  AN/SPY- IB  (in  later 
CG-47  class  ships)  are  the  results  of  ma¬ 
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jor  improvements  to  the  AN/SPY-1A  (in 
early  CG-47  class  ships).  The  upgrades 
in  the  antenna  group,  transmitter  and  sig¬ 
nal  processor  are  common  to  both  the  AN/ 
SPY-1B  and-lD  radar  systems.  To  date 
all  testing  of  the  AN/SPY- IB  and  -ID  sys¬ 
tems  has  been  conducted  at  CSEDS.  The 
AN/SPY-1A  has  undergone  extensive 
OT&E  at  sea. 

The  CSEDS  includes  a  mockup  of  the 
DDG-51  Combat  Information  Center 
(CIC)  using  standard  Navy  display  and 
weapon  system  consoles.  A  combination 
of  actual  equipment  (including  an  AN/ 
SPY-ID  radar)  and  simulators  provide  a 
fully  operational  prototype  of  CIC.  For 
safety  reasons,  no  actual  firing  is  permit¬ 
ted  at  CSEDS.  The  vertical  launching  sys¬ 
tem  and  5  incn/54  gun  mount  are  repli¬ 
cated  by  simulators.  The  major 
differences  between  the  AN/SPY-ID  radar 
system  configuration  at  CSEDS  and  that 
for  the  DDG-51  are:  (1)  only  one  antenna 
array  is  installed;  (2)  the  array  power  sup¬ 
plies  are  commercial  units;  (3)  the  signal 
processor’s  full  Moving  Target  Indicator 
MIT)  capabilities  are  not  installed;  and 
4)  the  transmitter  has  two  rather  than 
three  radio  frequency  amplifiers. 

In  October  1985  the  final  phase  of  the 
Initial  Operational  Test  and  Evaluation 
(IOT&E)  of  the  AN/SPY-  IB  was  com¬ 
pleted  at  CSEDS.  The  Navy’s  independ¬ 
ent  operational  test  agent.  Commander, 
Operational  Test  and  Evaluation  Force 
(COMOPTEVFOR),  recommended  full 
fleet  introduction  of  the  AN/SPY-1B  and 
the  Navy  subsequently  authorized  full  pro¬ 
duction.  The  AN/SPY-ID  radar  system 
was  approved  for  limited  production.  The 
first  phase  of  IOT&E  (OT-IIC)  on  the  AN/ 
SPY-ID  radar  was  conducted  as  a  com¬ 
bined  developmental  and  operational  test 
(DT/OT)  in  June  1986.  COMOPTEVFOR 
concluded  that  the  AN/SPY-ID  was  poten¬ 
tially  operationally  effective  and  poten¬ 
tially  operationally  suitable,  and  recom- 
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mended  continued  limited  fleet 
introduction. 


The  second  phase  of  IOT&E  (OT-EID1) 
was  conducted  at  CSEDS  as  combined 
DT/OT  in  November  1987.  The  third 
phase  of  IOT&E  (OT-IID2)  on  the  AN/ 
SPY- ID  was  a  strictly  operational  test 
conducted  at  CSEDS  in  conjunction  with 
the  September  1988  DDG-51  AEGIS 
Combat  System  OT&E.  Both  of  these 
tests  were  conducted  in  accordance  with  a 
test  plan  approved  by  the  DOT&E.  Be¬ 
tween  these  two  phases  of  testing,  an  up¬ 
dated  Test  and  Evaluation  Master  Plan 
was  submitted  which  addressed  the  testing 
of  the  DDG-51  Gun  Weapon  System 
(GWS)  as  requested  by  this  office. 


OT&E  ISSUES 


The  primary  OT&E  issue  examined  during 
FY88  operational  testing  of  the  DDG-51 
AEGIS  Combat  System  was  its  ability  to 
detect,  track,  and  initiate  engagement  of 
threat  representative  targets  in  a  multi¬ 
warfare  environment.  Other  issues  in¬ 
cluded  the  interoperability  of  the  various 
DDG-51  combat  system  elements  and  the 
AEGIS  Combat  System  reliability,  main¬ 
tainability,  and  availability. 


Two  phases  of  IOT&E  on  the  AN/ 
SPY-ID  radar  system  were  conducted  in 
FY88.  The  primary  OT&E  issues  exam¬ 
ined  during  OT-IID1  were  the  radar’s 
search,  detection,  track  and  missile  en¬ 
gagement  support  capabilities  in  a  clear 
and  electronic  countermeasure  (ECM)  en¬ 
vironment  against  AAW  targets.  Suitabil¬ 
ity  issues  assessed  included  reliability, 
maintainability,  availability,  interop¬ 
erability,  and  human  factors.  The  objec¬ 
tives  of  OT-IID2  included  those  of  OT- 
IID1  as  well  as  the  ability  of  the  radar 


system  to  support  GWS  engagements 
against  air,  surface  and  shore  targets. 

OT&E  ASSESSMENT 

The  results  of  the  OT&E  on  the  DDG-51 
AEGIS  Combat  System  are  still  being  ana¬ 
lyzed  and  will  be  reported  in  the  FY  89 
DOT&E  Annual  Report. 

During  OT-EDD1,  fifteen  raids  of  multi¬ 
ple  aircraft  were  conducted  using  F-14, 
A-6,  and  Lear  Jet  aircraft,  with  an 
NKC-135  and  an  ECM  configured  Lear 
Jet  providing  active  ECM.  Two  raids  were 
presented  without  ECM,  seven  raids  pre¬ 
sented  a  single  ECM  platform,  and  six 
raids  used  both  ECM  aircraft.  Manned 
aircraft  profiles  were  designed  to  test  the 
system’s  capability  to  track  and  success¬ 
fully  support  engagement  of  targets  in  a 
variety  of  threat  representative  tracking 
environments.  Computer  simulated  tar¬ 
gets  were  introduced  into  the  radar  system 
to  replicate  Antiship  Missile  (ASM)  pro¬ 
files  including  high  speed,  high  and  low 
altitude,  and  small  radar  cross  section  tar¬ 
gets.  There  were  several  major  test  limita¬ 
tions  including:  chaff  could  not  be  de¬ 
ployed  due  to  adverse  environmental 
conditions;  only  non-firing  engagements 
were  conducted;  electromagnetic  radiation 
restrictions  at  CSEDS  limit  the  radar 
power  from  zero  to  two  degrees  in  eleva¬ 
tion;  the  system  configuration  and  matur¬ 
ity  of  the  computer  programs  did  not  allow 
a  full  assessment  of  reliability  and  avail¬ 
ability;  and  some  of  the  radar  interfaces 
with  other  systems  were  not  installed. 
COMOPTEVFOR  concluded  that  the  AN/ 
SPY- ID  radar  system  was  potentially  op¬ 
erationally  effective  and  potentially  opera¬ 
tionally  suitable.  He  recommended 
continued  limited  fleet  introduction  after 
corrections  are  made  in  two  areas  of  sys¬ 
tem  performance. 

In  OT-DD2,  41  manned  aircraft  raids 
were  conducted  using  F/A-18,  A-6,  and 
Lear  Jet  aircraft,  with  an  NKC-135, 
EA-6B,  and  an  ECM  configured  Lear  Jet 
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providing  ECM.  Ten  raids  were  presented 
in  a  clear  environment.  Eighteen  raids  in¬ 
cluded  active  ECM.  Chaff  corridors  were 
laid  during  four  raids,  and  nine  presenta¬ 
tions  included  a  combination  of  ECM  and 
chaff.  The  major  test  limitations  included 
those  discussed  above  for  OT-HD1,  except 
that,  although  they  were  not  fully  threat 
representative  because  of  FAA  restric¬ 
tions,  chaff  corriuors  were  used  in  GT- 
DD2.  The  objectives  of  OT-  HD2  included 
the  assessment  of  the  AN/SPY-ID  in  sup¬ 
port  of  the  GWS.  Significant  test  limita¬ 
tions  associated  with  the  GWS  testing  in¬ 
cluded:  the  AN/SPY-ID  to  GWS  interface 
was  not  fully  developed,  precluding  a  full 
assessment;  and  restrictions  imposed  by 
the  land-based  test  site  limited  surface  en¬ 
gagements  to  simulated  targets  and  pre¬ 
cluded  a  full  assessment  of  the  radar's 
support  of  Naval  Gun  Fire  Support 


(NGFS).  COMOPTEVFOR  concluded 
that  the  AN/SPY-ID  radar  system  was  po¬ 
tentially  operationally  effective  and  poten¬ 
tially  operationally  suitable,  and  recom¬ 
mended  continued  limited  introduction  in 
DDG-51  class  ships  scheduled  for  com¬ 
missioning  prior  to  the  completion  of  at- 
sea  IOT&E. 

SUMMARY 

The  FY88  OT&E  of  the  AN/SPY-ID  radar 
indicates  it  is  potentially  operationally  ef¬ 
fective  and  potentially  operationally  suit¬ 
able,  and  supports  its  continued  procure¬ 
ment  for  DDG-51  ship  construction  until 
OT&E  can  be  conducted  on  the  first 
DDG-51  class  ship.  The  results  of  the 
FY88  OT&E  on  the  DDG-51  AEGIS  Com¬ 
bat  System  is  still  being  analyzed  and  will 
be  reported  in  the  FY89  DOT&E  Annual 
Report. 
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ASPJ  (ALQ-165) 


SYSTEM  DESCRIPTION 

The  AN/ ALQ-165  Electronic  Countermea¬ 
sures  (ECM)  Pod  is  a  modular  reprogram¬ 
mable  self-protection  jamming  system  de¬ 
signed  to  protect  Navy  and  Air  Force 
tactical  aircraft  against  a  variety  of  radar 
threats.  A  pod  version  is  available  for  the 
AV-8B.  The  system  is  supported  by  the 
Navy  developed  Advanced  Electronic  War¬ 
fare  Test  Set  (AEWTS),  but  neither  the 
Navy  nor  Air  Force  is  expected  to  field  the 
system  with  this  support.  Fielded  support 
systems  will  be  integrated  with  the  basic 
aircraft  support  systems. 

BACKGROUND 

The  AN/ALQ-165  joint  Air  Force  and 
Navy  program  engineering  development 


program  began  in  1981.  Twelve  engineer¬ 
ing  development  models  (EDM)  were  de¬ 
livered  by  1985.  The  Secretary  of  the 
Navy  capped  the  program  to  limit  govern¬ 
ment  liability  in  1984.  An  award  for  six 
production  verification  units  was  made  in 
1987.  Effectiveness  assessment  tests  com¬ 
pleted  early  in  1988  supported  execution 
of  an  option  for  14  additional  production 
verification  units  in  August  1988.  The 
system  completed  development  tests  in 
May  1988  and  operational  tests  began  in 
June  1988.  Operational  tests  are  sched¬ 
uled  in  four  phases  but  a  fifth  may  be 
added.  The  OSD-approved  phases  are: 

(1)  OT-IIA  quicklook  aircraft  effective¬ 
ness  tests  to  determine  if  additional  pro¬ 
duction  verification  units  are  warranted; 

(2)  OT-HB  simulation  tests  at  the  Air 
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Force  Electronic  Warfare  Evaluation 
Simulator  (AFEWES)  (additional  OT-HB 
tests  will  be  conducted  after  OT-DC);  (3) 
OT-IIC  comprehensive  system  effective¬ 
ness  and  system  suitability  (successful 
accomplishment  of  this  phase  will  be  con¬ 
sidered  by  the  DAB  in  approving  low  rate 
initial  production  (LRIP));  (4)  OT-IID 
comprehensive  system  effectiveness  and 
suitability  testing  on  F-18C  and  F-16C 
Block  40  aircraft  (these  aircraft  are  desig¬ 
nated  as  the  first  aircraft  to  deploy  with 
the  AN/ALQ-165);  and  (5)  OT-HE*  com- 
prehensive  tests  of  the  production  verifica¬ 
tion  models,  which  may  be  necessary  be¬ 
fore  proceeding  to  full-rate  production 
(the  necessity  of  this  phase  is  expected  to 
be  determined  by  the  DAB  in  1989). 

OT&E  ISSUES 

The  major  objectives  are:  (1)  evaluate  the 
capability  to  provide  tactical  aircraft  self¬ 
protection,  (2)  assess  reliability,  (3)  assess 
maintainability,  (4)  assess  the  built-in-test 
(BIT),  (5)  evaluate  the  reprogrammability 
of  the  pod,  and  (6)  assess  the  suitability  of 
the  AN/ALQ-165  for  operation  in  its  in¬ 
tended  environment. 


OT&E  ACTIVITY 

The  ALQ-165  OT-DA  was  started  in  June 
1988  with  F-16A  flight  tests  at  Eglin  AFB, 
Florida,  and  F-18A  flight  tests  at  the  Na¬ 
val  Weapons  Center,  China  Lake,  Califor¬ 
nia.  The  OT-DA  flight  tests  were  com¬ 
pleted  in  July  1988.  The  Air  Force  began 
simulation  tests  (OT-DB)  at  AFEWES  in 
August  1988  and  the  Navy  began  OT-DC 
flight  tests  in  July  1988. 

OT&E  ASSESSMENTS 

OSD  delegated  the  additional  production 
verification  procurement  to  the  services. 
The  Air  Force  and  Navy  operational  test 
activities  (OTA)  recommended  the  pro¬ 
duction  verification  units  be  procured 
based  on  the  satisfactory  completion  of 
OT-DA.  The  Air  Force  OTA  referred  to 
the  AN/ALQ-165  as  “the  best  ECM  sys¬ 
tem  seen  tested.”  The  OT-DA  indicates 
the  AN/ALQ-165  has  the  potential  to  be 
operationally  effective.  Insufficient  data 
was  obtained  to  determine  the  potential 
for  operational  suitability. 
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SYSTEM  DESCRIFflON 


The  AV-8B  Harrier  H  is  a  second-genera¬ 
tion,  single-seat,  transonic,  vertical/short 
takeoff  and  landing  (V/STOL),  light  attack 
aircraft.  It  is  powered  by  a  single,  vec¬ 
tored  thrust  F402-RR-406  engine.  The 
AV-8B  is  capable  of  operating  from  short 
fields,  forward  sites,  roads,  and  surface 
ships.  It  includes  such  improvements  over 
the  AV-8A  as  a  larger  supercritical  wing, 
positive  circulation  flaps,  lift  improvement 
devices,  enlarged  intakes,  and  advanced 
composite  materials  applications  in  major 
structural  elements  of  the  wing,  forward 
fuselage,  and  empennage.  It  also  incorpo¬ 
rates  an  updated  weapons  system  to  im¬ 
prove  weapons  delivery  effectiveness  and 
tactical  flexibility.  The  mission  computer 


and  its  associated  Omnibus  software  man¬ 
age  most  communication,  navigation,  and 
weapon  systems  functions.  The  AV-8B  is 
capable  of  carrying  a  wide  variety  of  con¬ 
ventional  air-to-ground  weaponry,  the 
GAU-12  25mm  gun,  and  Sidewinder  air- 
to-air  missiles. 

A  night-attack  system  has  been  incor¬ 
porated  as  an  engineering  change  proposal 
(ECP)  to  the  AV-8B.  It  expands  the  day¬ 
light  visual  meteorological  conditions 
(VMC)  mission  capabilities  of  the  aircraft 
to  include  night  VMC  through  the  use  of 
various  complementary  subsystems. 
These  include  a  forward-looking  infrared 
(FUR)  navigation  system,  an  expanded 
head-up  display  (HUD),  a  night  vision 
goggles  system  (NVGS),  NVG  compatible 
cockpit  lighting,  and  a  color  moving  map/ 
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display.  In  addition,  target  acquisition  ca¬ 
pabilities  are  expected  to  be  expanded 
during  day  and  night  operations. 

The  TAV-8B  is  a  two-place  trainer, 
derived  from  the  AV-8B,  which  retains 
maximum  commonality  in  handling  quali¬ 
ties,  inflight  performance  and  logistics 
support.  The  AV-8B  cockpit  is  moved 
forward,  and  a  second  cockpit  with  its  as¬ 
sociated  equipment  is  placed  above  and 
behind.  The  TAV-8B  is  slightly  heavier 
than  the  AV-8B,  and  certain  systems  such 
as  the  angle  rate  bombing  system  (ARBS) 
and  the  electronic  warfare  (EW)  suite 
have  been  deleted. 

BACKGROUND 

The  AV-8B  was  designed  to  replace  the 
A-4M  and  AV-8A  to  meet  the  Marine 
Corps*  iight  attack  requirements  through 
the  year  2000.  It  first  flew  in  November 
1981.  It  completed  OPEVAL  in  March 
1985  and  IOC  was  declared  in  August 
1985.  FOT&E  of  various  subsystems,  ord¬ 
nance,  and  updates  of  the  Omnibus  mis¬ 
sion  computer  software  continues. 

The  AV-8B  night-attack  system  is  in¬ 
tended  to  increase  the  time  available  for 
the  AV-8B  to  accomplish  its  primary  mis¬ 
sion  by  over  40  percent.  The  system  is 
expected  to  provide  a  night  tactical  naviga¬ 
tion  capability  to  levels  approaching  or 
equaling  day  VMC,  to  improve  its  day  and 
night  operational  capabilities,  and  to  in¬ 
crease  night  flight  safety. 

The  TAV-8B  was  developed  to  satisfy 
the  Marine  Corps’  requirement  for  a  V/ 
STOL  training  aircraft  for  the  AV-8B.  Its 
primary  function  will  be  to  train  V/STOL 
attack  pilots  for  the  fleet.  It  will  be  em¬ 
ployed  as  a  transition  trainer  to  familiarize 
Marine  Corps  pilots  with  the  flight  con¬ 
trols,  flight  characteristics,  weapons,  and 
basic  tactical  use  of  the  AV-8B.  The 
TAV-8B  completed  OT-DIA  in  August 


1987.  The  test  results  were  reported  in 
the  FY87  DOT&E  Annual  Report. 

OT&E  ISSUES 

AV-8B  Omnibus  5  software  issues  fo¬ 
cused  on  improvements  to  and  deficiency 
corrections  of  the  previous  mission  com¬ 
puter  software  and  expansion  of  the  air- 
to-ground  weapons  clearances.  Issues  as¬ 
sociated  with  the  electronic  warfare  (EW) 
suite,  the  ALQ-164  and  ALR-67,  focused 
primarily  on  the  effectiveness  and  suitabil¬ 
ity  of  the  suite  once  it  is  installed  in  the 
AV-8B.  Its  effect  on  aircraft  survivability 
is  of  particular  interest.  The  AV-8B 
night-attack  system  test  objectives  were  to 
(1)  determine  the  capability  of  the  AV-8B 
to  conduct  single  and  two-plane  night 
close  air  support  (CAS);  (2)  determine  its 
capability  to  conduct  night  vertical  short 
takeoff  and  landing  (V/STOL)  operations; 
(3)  determine  if  the  night  attack  system 
will  be  reliable,  maintainable,  and  avail¬ 
able  in  austere  employment  environments; 
and  (4)  assess  supportability,  compatibil¬ 
ity,  interoperability,  training,  human  fac¬ 
tors,  safety,  and  technical  documentation. 

OT&E  ACTIVITY 

Operational  testing  of  the  ALQ-164  and 
ALR-67  EW  suite  began  in  July  1987  and 
was  completed  in  November  1987.  The 
COMOPTEVFOR  test  report  is  expected 
to  be  released  in  January  1989.  Our  as¬ 
sessment  will  be  included  in  our  next  An¬ 
nual  Report. 

OT&E  ASSESSMENT 

Operational  testing  of  the  Omnibus  5  mis¬ 
sion  computer  software,  the  follow-on  to 
the  Omnibus  4  software,  was  conducted  at 
NWC  China  Lake,  California,  MCAS 
Cherry  Point,  North  Carolina,  and  Eglin 
AFB,  Florida  ranges  from  July  8  to  Sep¬ 
tember  16,  1988.  A  total  of  39  sorties  and 
42.6  flight  hours  were  flown.  All  quantita¬ 
tive  effectiveness  criteria  lor  Omnibus  5 
were  achieved  with  no  deficiencies  noted 
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in  aircraft  performance.  Minor  software- 
related  deficiencies  were  identified  during 
the  test.  Deficiencies  noted  in  Omnibus  5 
testing  were  designated  for  correction  in 
Omnibus  7  or  follow-on  software.  Omni¬ 
bus  5  was  assessed  to  be  operationally  ef¬ 
fective  and  operationally  suitable. 

Operational  testing  (OT-DIA)  of  the 
AV-8B  night-attack  system  commenced  in 
October  1987  and  was  finished  in  June 
1988.  Concurrent  contractor,  DT,  and  OT 
operations  were  conducted  because  only 
one  fully  equipped  night-attack  test  air¬ 
craft  was  available.  Testing  was  con¬ 
ducted  at  China  Lake,  California;  CFB 
Cold  Lake,  Canada;  MCAGCC;  29  Palms, 
California;  and  WSMR,  New  Mexico,  in  a 
variety  of  terrain  and  meteorological  con¬ 
ditions.  There  were  145  operational  test 
sorties  and  183.7  flight  hours,  with  68  sup¬ 
port  sorties  and  77.5  flight  hours  flown  in 
the  AV-8B  and  TAV-8B.  Limitations  to 
the  test  included:  (1)  no  operations  were 
conducted  from  aircraft-capable  ships;  (2) 
vulnerability  testing  was  not  conducted; 
(3)  contractor  maintenance  and  logistic 
support  were  provided  due  to  lack  of  sys¬ 
tem  maturity;  (4)  only  one  fully  equipped 
night-attack  AV-8B  was  available  (this  re¬ 
sulted  in  limited  spare  weapon  replaceable 
assemblies  and  limited  the  ability  to  assess 
two-plane  tactics);  (5)  the  available  tar¬ 
gets  were  not  always  threat  representative; 
and  (6)  the  system  may  not  have  been 
tested  against  all  countermeasures. 

The  AV-8B  night-attack  system  dem¬ 
onstrated  the  capability  to  employ  typical 
daylight  tactics  during  the  hours  of  dark¬ 
ness,  with  at  least  minimum  ambient  light 
levels.  Improved  navigation,  target  acqui¬ 
sition,  and  target  attack  capability  at  night, 
and  the  ability  to  operate  in  low-visibility 
conditions  during  daylight,  as  compared  to 
the  current  AV-8B  system  were  demon¬ 
strated.  It  is  important  to  note  that,  al¬ 
though  the  night-attack  system  provided  a 
significant  increase  over  unaided  vision  at 
night  and  in  low-visibility  conditions,  it 


did  not  “turn  night  into  day."  Because  of 
the  reliance  on  artificial  cues  for  low-alti¬ 
tude  terrain  avoidance,  navigation,  and 
target  detection,  the  operating  altitudes 
varied  from  100  to  200  feet  above  that 
which  could  be  achieved  during  daylight 
hours  over  the  same  terrain.  The  weapons 
delivery  system  performance  was  equal  to 
daytime  delivery.  The  AV-8B  night-at¬ 
tack  system  was  assessed  for  both  aircraft 
and  night-attack  sensor  susceptibility. 
The  ability  to  maneuver  dynamically  at 
night  was  slightly  reduced  when  compared 
to  daylight,  due  to  the  lack  of  visual  cues. 
When  compared  to  the  current  night  capa¬ 
bility,  there  was  a  quantum  improvement. 
This,  combined  with  the  night-attack  sys¬ 
tem’s  ability  to  use  darkness  to  effectively 
negate  optically  guided  weapons  systems 
and  visual  detection  by  enemy  ground 
forces  decreased  its  overall  susceptibility. 
More  than  25  night  test  passes  were  run 
against  various  electro-optical  counter¬ 
measures  (EOCM).  The  Electro-optical 
Counter  Countermeasures  Test  and  Evalu¬ 
ation  Directorate  is  still  reducing  and  ana¬ 
lyzing  the  data  collected.  The  results  will 
be  reported  in  our  next  Annual  Report. 

Night  V/STOL  launch  and  recoveries, 
in  conditions  ranging  from  starlight 
through  full-moon  conditions,  were  safely 
and  effectively  accomplished.  This  in¬ 
cluded  operations  from  roads  and  con¬ 
fined  areas.  In  all  cases,  the  use  of  IR 
beacon(s)  or  lamp(s)  made  the  takeoff 
and  landing  evolution  easier  because  of 
lineup  cues  and  improved  ambient  light 
conditions. 

The  limited  flight  time  prevented  a 
complete  evaluation  of  system  reliability, 
although  it  was  assessed  as  unsatisfactory. 
The  lack  of  system  maturity  precluded  the 
ability  to  document  meaningful  maintain¬ 
ability,  availability,  logistic  supportability, 
and  training  results  (see  test  limitations 
above).  Compatibility  was  determined  to 
be  unsatisfactory  because  of  major  defi¬ 
ciencies.  There  were  minor  inter- 
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operability  problems  associated  with 
multi-aircraft  operations  and  landing  area 
lighting  requirements.  Human  factors, 
safety,  and  documentation  were  all  as¬ 
sessed  as  adequate,  with  minor  deficien¬ 
cies. 

SUMMARY 

Within  the  constraints  imposed  by  the  test 
limitations,  the  AV-8B  is  assessed  to  be 


operationally  effective  and  potentially  op¬ 
erationally  suitable. 

FOT&E  of  the  Omnibus  software  to 
correct  deficiencies  and  improve  system 
capabilities  will  continue  on  an  annual  ba¬ 
sis.  Further  testing  of  other  system  up¬ 
grades,  such  as  the  upgraded  408  engine, 
are  planned  in  1989. 


IV-28 


AV-8B  HARRIER  II 


BLU-80B  CHEMICAL  WEAPON  SYSTEM  (BIGEYE) 


SYSTEM  DESCRIPTION 

The  Bigeye  is  a  500  pound  class  freefall 
canister  binary  chemical  weapon  designed 
for  single  or  multiple  carriage  on  tactical 
fighter  aircraft.  Designed  to  be  capable  of 
supersonic  carriage  and  high  subsonic  re¬ 
lease  airspeeds,  Bigeye  is  intended  to  be 
compatible  with  level,  loft,  and  dive  deliv¬ 
eries.  It  produces  a  persistent  nerve  agent 
from  two  nontoxic  chemicals  which  are 
physically  separated  within  the  Bigeye 
airframe  until  the  weapon  has  been  re¬ 
leased  from  the  aircraft.  The  basic  com¬ 
ponents  of  the  Bigeye  weapon  include  the 
FMU-140/B  dispenser  proximity  fuze,  re¬ 
actor  assembly  (including  liquid  reactant 


(QL),  ballonet  assembly  (including  sulfur 
reactant),  and  tail-fin  assembly. 

BACKGROUND 

Inherent  problems  with  the  storage,  trans¬ 
portation,  and  employment  of  toxic  chemi¬ 
cal  weapons  led  the  DoD  to  seek  a  safer, 
more  reliable  method  to  achieve  chemical 
warfare  deterrence.  A  binary  concept,  two 
nontoxic  chemicals  physically  separated 
until  used,  evolved  as  the  most  plausible 
solution.  In  1976  the  Navy  was  designated 
the  executive  agent  for  development  of  the 
Bigeye,  with  the  Air  Force  as  the  partici¬ 
pating  Service  and  the  Army  as  the  sup¬ 
porting  Service  responsible  for  chemical 
development  and  evaluation.  Funding 
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shortfalls  in  FY80  resulted  in  a  restructur¬ 
ing  of  the  program  and  a  decision  to  place 
it  in  a  hold  status  at  the  end  of  that  year. 
Renewed  interest  in  the  program  during 
FY81  resulted  in  a  decision  to  complete 
development  as  quickly  as  possible.  The 
design  of  the  system  was  changed  in  FY82 
to  allow  the  chemical  reactant  to  mix  after 
the  weapon  was  released  from  the  aircraft 
("off-station  mixing").  Operational  test¬ 
ing  of  this  design  began  in  FY85. 

OT&E  ISSUES 

The  operational  effectiveness  issues  being 
examined  during  operational  testing  in¬ 
clude  delivery  accuracy  of  the  system,  ca¬ 
pability  of  providing  desired  deposition 
densities  when  delivered  with  operation¬ 
ally  realistic  maneuvers,  successful  em¬ 
ployment  under  all  conditions  encountered 
during  mission  operations  and  whether  the 
required  delivery  maneuvers  will  result  in 
an  unacceptable  increase  in  delivery  air¬ 
craft  vulnerability.  Suitability  issues  in¬ 
clude  reliability,  availability,  maintainabil¬ 
ity  (RAM);  logistic  supportability; 
environmental  compatibility;  inter¬ 
operability;  training;  and  safety  during 
transportation,  handling,  loading,  delivery, 
and  jettison  from  the  aircraft, 

OT&E  ACTIVITY 

To  date,  the  Navy  and  Air  Force  have  con¬ 
ducted  two  phases  of  joint  operational  test¬ 
ing.  The  Navy  completed  Phase  I  testing 
(OT-DA)  on  September  5,  1985.  Twenty- 
two  weapons  were  dropped  at  Naval 
Weapons  Center,  China  Lake,  California, 
and  Dugway  Proving  Ground,  Utah.  The 
Commander,  Operational  Test  and  Evalu¬ 
ation  Force  (COMOPTEVFOR)  concluded 
that  the  BLU-  80/B  was  potentially  opera¬ 
tionally  effective  and  potentially  operation¬ 
ally  suitable  and  recommended  only  lim¬ 
ited  fleet  introduction  until  compliance 
with  several  recommendations. 

Phase  I  of  the  Air  Force  IOT&E  was 
conducted  at  Nellis  AFB,  Nevada,  from 


April  1985  to  February  1986.  Twenty 
BLU-80B  weapons  were  dropped  from 
F-4  and  F-16  aircraft  at  China  Lake  and 
Dugway.  The  Commander,  Air  Force  Op¬ 
erational  Test  and  Evaluation  Center 
(AFOTEC)  concluded  that  BLU-80B  op¬ 
erational  effectiveness  was  satisfactory 
and  operational  suitability  was  unsatisfac¬ 
tory,  and  recommended  proceeding  to 
low-rate  initial  production  (LRIP). 

Joint  USAF  IOT&E  (Phase  n)  and 
Navy  OT-IIB  (OPEVAL)  testing  of  Bigeye 
commenced  January  1987.  After  10  weap¬ 
ons  were  test  dropped,  the  weapon  was 
decertified  in  March  1987  by  the  Com¬ 
mander,  Naval  Air  Systems  Command 
(COMNAVAIRSYSCOM)  due  to  excessive 
failures.  During  this  pause  in  testing,  the 
Navy  conducted  a  failure-mode  analysis 
and  modified  the  tail-fin  actuator  assem¬ 
bly  and  the  FZU-37  air  turbine  generator 
fuze.  Recertification  was  approved  in 
August  1987,  and  testing  recommenced  on 
24  August.  A  member  of  the  DOT&E 
staff  witnessed  portions  of  the  testing, 
both  on  the  ground  at  Dugway  and  in  the 
air  from  an  Air  Force  F-16  chase  plane. 
Operational  testing  (OT-IIB)  of  a  com¬ 
bined  Navy  and  Air  Force  total  of  58 
weapons  was  completed  in  December 
1987.  COMOPTEVFOR  issued  a  final 
joint  Navy/Air  Force  report  in  June  1988 
that  supported  continued  limited  produc¬ 
tion  for  operational  testing.  Limited  fleet 
introduction  was  not  recommended.  Prior 
to  approving  the  Bigeye  Test  and  Evalu¬ 
ation  Master  Plan  (TEMP)  and  the  opera¬ 
tional  test  plan,  this  office  persuaded 
COMOPTEVFOR  to  include  in  his  final 
OT-IIB  report  an  Army  appendix  that  con¬ 
tains  the  results  of  the  Army’s  effective¬ 
ness  modeling  based  on  chemical  simulant 
data  collected  during  OT-IIB. 

In  January  1988,  on  the  recommenda¬ 
tion  of  the  Secretary  of  Defense  and  in  ac¬ 
cordance  with  Section  152  of  the  National 
Defense  Authorization  Act  for  FY87  (Pub¬ 
lic  Law  99-661),  the  President  certified 
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that  (1)  production  of  the  Bigeye  binary 
chemical  bomb  is  in  the  national  security 
interest  of  the  United  States,  and  (2)  the 
design,  planning,  and  environmental  re- 
quirements  for  production  facilities  have 
been  satisfied.  On  the  recommendation  of 
this  office,  production  will  be  held  to  a 
minimum,  no  Bigeye  bombs  will  be  de- 


of  operational  testing  is  fully  successful. 

While  the  provisions  of  10  U.S.C.  138 
do  not  require  the  DOT&E  to  submit  a  re¬ 
port  on  operational  test  adequacy  and  sys¬ 
tem  operational  effectiveness  and  suitabil¬ 
ity  until  a  decision  is  to  be  made  to 
proceed  beyond  LRIP,  an  interim  report 
was  submitted  to  Congress  in  August 
1988.  The  results  of  operational  testing 
conducted  as  of  that  time  were  not  suffi¬ 
cient  to  provide  a  basis  for  an  assessment 
of  operational  effectiveness  and  suitabil¬ 
ity. 

OT&E  INTERIM  ASSESSMENT 

The  OT-IIB  operational  testing  was  de¬ 
signed  to  resolve  operational  effectiveness 
issues  of  delivery  accuracy,  deposition 
density,  and  operational  suitability  issues, 
including  hardware  reliability.  Results 
from  this  phase  of  testing,  if  positive,  were 
to  have  supported  a  full-rate  production 
decision.  While  the  TEMP  and  test  plan 
criteria  for  agent  deposition  density  were 
met,  the  delivery  accuracy  and  reliability 
criteria  were  not.  Other  questions  remain 
unanswered  and  will  require  further  test¬ 
ing:  the  Bigeye  bombs  tested  were  pre- 
production  prototype  models,  not  fully 
representative  of  the  factory-built  produc¬ 
tion-representative  weapon  configuration; 
certain  employment  maneuvers  and  tactics 
used  when  delivering  the  Bigeye  may  re¬ 
sult  in  an  unacceptable  increase  in  aircraft 
vulnerability;  and  a  measurable  criterion 


for  mission  success  (end-to-end)  will  be 
needed  in  order  to  establish  the  likelihood 
of  completing  a  mission  successfully  and 
effectively. 

Although  the  data  analysis  and  evalu¬ 
ation  of  OT-HB  test  results  did  not  provide 
a  conclusive  basis  for  an  assessment  of 
operational  effectiveness  and  suitability, 
the  results  indicate  that  Bigeye  has  the  po¬ 
tential  to  be  operationally  effective  and 
operationally  suitable.  Because  reliability 
was  below  threshold,  this  office  requested 
that  two  independent  producibility  studies 
be  done,  one  by  OSD  and  one  by  the 
Navy.  Based  on  the  results  of  these  stud¬ 
ies,  the  DOT&E  test  observations,  and  the 
OT-IIB  report,  this  office  recommended 
that  production  be  held  to  a  low  rate  and 
further  operational  testing  be  conducted 
using  production-representative  weapons. 

SUMMARY 

Within  the  constraints  imposed  by  the 
limitations  to  the  scope  of  testing  to  date, 
the  Bigeye  chemical  bomb  has  demon¬ 
strated  the  potential  to  be  operationally  ef¬ 
fective  and  suitable.  These  findings  do 
not  support  a  recommendation  for  full- 
rate  production.  These  findings  do  sup¬ 
port  continued  full-scale  engineering  de¬ 
velopment  to  correct  deficiencies. 
Low-rate  initial  production  to  create  arti¬ 
cles  for  testing  should  be  conducted,  and 
further  operational  testing  should  be  con¬ 
ducted  (and  is  planned  by  FY90)  on  pro¬ 
duction-representative  Bigeye  weapons  to 
determine,  prior  to  a  full-rate  production 
decision,  whether  or  not  the  system’s  defi¬ 
ciencies  and  limitations  to  the  scope  of 
testing  has  been  satisfactorily  resolved. 
The  DOT&E’ s  final  report  will  be  submit¬ 
ted  at  the  conclusion  of  the  next  phase  of 
operational  testing,  prior  to  the  full-rate 
production  decision. 
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SYSTEM  DESCRIPTION 


The  CH-53E  is  an  improved/growth  ver¬ 
sion  of  the  Navy/Marine  Corps  H-53A/D 
transport  helicopter.  It  features  a  third  en¬ 
gine,  a  larger  diameter  rotor,  seven  (ver¬ 
sus  six)  main  rotor  blades,  an  uprated 
main  transmission,  and  a  greater  maxi¬ 
mum  gross  weight  and  payload  capability. 
Maximum  payload  is  16  tons  for  the 
CH-53E  vice  8  tons  for  the  earlier 
H-53A/D  aircraft.  The  CH-53E  is  cur¬ 
rently  in  full  production  and  is  employed 
by  both  Marine  Corps  and  Navy  fleet 
units.  The  MH-53E  is  a  variant  of  the 
H-53E  and  was  recently  approved  for  full 
production  for  use  in  the  airborne  mine- 
countermeasures  (AMCM)  mission.  There 
is  80  percent  commonality  between  the 


MH  and  CH  aircraft,  with  the  main  rotor, 
engines,  transmissions,  and  basic  airframe 
being  essentially  the  same. 

BACKGROUND 

The  MH-53E  was  developed  as  an  engi¬ 
neering  change  proposal  modification  to 
the  CH-53E  aircraft,  intended  to  replace 
the  RH-53D  as  the  Navy’s  airborne 
AMCM  platform.  The  MH-53E  is  de¬ 
signed  to  increase  time  on  station  and  im¬ 
prove  mission  reliability,  as  well  as  to  pro¬ 
vide  the  increased  tow  capability  required 
by  new  AMCM  devices.  Initial  operational 
testing  (OT-IIA)  was  conducted  in  1984. 
Based  on  OT-IIA  and  development  test  re¬ 
sults,  a  limited  production  decision  was 
made  in  March  1985.  Operational  evalu¬ 
ation  (OT-IIB)  of  the  MH-53E  was 
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conducted  in  FY86  and  reported  upon  in 
our  FY86  Annual  Report.  OT-IIB  test  ob¬ 
jectives  included  a  determination  of  the 
MH-53’s  capability  to  stream,  tow  and  re¬ 
cover  AMCM  towed  bodies,  and  navigate 
with  the  accuracy  required  to  conduct 
AMCM  operations.  Major  deficiencies 
identified  in  OT-IIB  included  recovera¬ 
bility  with  single-engine  failure  during  tow 
operations,  full-throw  authority  of  the  cy¬ 
clic  during  emergencies,  readability  of  the 
tension  skew  indicator,  durability  of  the 
main  and  tail  rotor  bearings  and  rotor 
brake  slippage.  Based  on  FY86  test  re¬ 
sults,  continued  low  production  of  the 
MH-53E  was  recommended.  No  opera¬ 
tional  testing  occurred  in  FY87. 

OT&E  ISSUES 

In  FY88,  the  Navy  conducted  follow-on 
operational  test  and  evaluation  (OT-IIIA) 
of  the  MH-53E.  The  objectives  of  OT- 
IIIA  were  to  assess  production  fixes  to 
OT-DOB  deficiencies,  assess  interim  fixes 
for  those  OT-IIB  deficiencies  with  long¬ 
term  solutions,  and  determine  the  readi¬ 
ness  of  the  MH-53E  for  full  production. 
OT-IIIA  testing  determined  that  the 
MH-53E  was  marginally  operationally  ef¬ 
fective  and  not  operationally  suitable.  Al¬ 
though  the  MH-53E  demonstrated  an  ade¬ 
quate  airborne  mine  countermeasures 
(AMCM)  tow  capability,  once  the  mine 
countermeasures  gear  was  streamed,  the 
integrated  system  was  not  considered  op¬ 
erationally  effective  for  the  conduct  of  the 
primary  AMCM  mission.  The  Precise 
Navigation  System  (PNS)  needed  improve¬ 
ment,  and  the  major  suitability  issues  of 
reliability,  maintainability,  compatibility, 
interoperability,  safety  and  human  factors 
required  resolution.  Major  deficiencies 
were  identified  in  OT-IIIA  for  correction 
and  testing  in  an  additional  phase  of  op¬ 
erational  test  and  evaluation.  These  defi¬ 
ciencies  were:  (1)  unresolved  OT-DB  de¬ 
ficiencies;  (2)  unsafe  conditions  created 
by  certain  AMCM  configurations  (safety); 
(3)  design  of  AMCM  equipment  inter¬ 


operability;  (4)  lack  of  a  reliable,  precise 
navigation  system  (reliability);  (5)  hazards 
during  emergency  egress  (safety);  (6)  ex¬ 
cessive  noise  levels  which  can  injure  hear¬ 
ing  and  cause  communication  difficulties; 
(7)  lack  of  ventilation  and  heating  during 
warm  and  cold  climates  (safety);  (8)  de¬ 
sign  of  fuel  sponsons  and  hardware 
(safety);  (9)  readability  of  cockpit  indica¬ 
tors  and  status  lights  (human  factors); 
(10)  stowage  provisions  to  eliminate  haz¬ 
ards  to  aircrew  movement  (human  fac¬ 
tors);  (11)  need  for  better  human  perform¬ 
ance  engineering  for  completion  of 
aircrew  and  maintenance  tasks  (human 
factors);  (12)  need  for  better  aircraft  and 
AMCM  equipment  logistic  support;  (13) 
training  deficiencies;  and  (14)  documenta¬ 
tion  deficiencies.  Limited  production  of 
eight  MH-53E  aircraft  was  granted  in 
April  1988.  The  DOT&E  considered  the 
Navy  to  have  proceeded  beyond  low-rate 
initial  production  with  this  decision  and 
submitted  to  the  Congress  a  B-LRIP  re¬ 
port  in  May  1988.  The  B-LRDP  report  con¬ 
tains  the  details  of  OT-IHA  testing. 

OT-IHB  was  conducted  in  December 
1987.  Its  objective  was  to  demonstrate  the 
transportability  of  the  MH-53E  aircraft  in 
a  C-5  aircraft.  The  test  was  considered 
successful  and  the  Air  Force  approved 
MH-53E  transportability. 

OT&E  ACTIVITY 

Additional  follow-on  testing  after  OT-IIIA 
was  directed  and  conducted  as  OT-IHA 
Phase  II  from  July  to  September  1988  for 
verification  of  corrections  to  deficiencies 
found  in  OT-IHA.  Testing  was  conducted 
by  Helicopter  Mine  Squadron  15  based  at 
Alameda  Naval  Air  Station,  California. 
The  test  involved  265.5  flight  hours  using 
a  variety  of  mine  countermeasures  equip¬ 
ment,  not  including  the  ALQ-141,  which 
could  not  be  tested.  Evaluation  deter¬ 
mined  that  the  PNS  needed  further  im¬ 
provement.  Suitability  issues  of  Mk-103 
compatibility  and  AMCM  mission  safety 
were  not  resolved  satisfactorily.  Reliability 
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in  the  AMCM  mission  remained  unsatis¬ 
factory.  Maintainability  was  unsatisfac¬ 
tory  and  higher  than  criterion.  Problems 
with  stream  and  recovery  operations,  high 
acoustic  noise  levels,  and  cockpit  PNS  in¬ 
strumentation  caused  safety  issues  to  re¬ 
main  unsatisfactory.  Because  of  inade¬ 
quate  PNS  publications,  training  was 
considered  unsatisfactory. 


SUMMARY 

It  is  our  judgment  that  the  MH-53  is  still 
only  marginally  operationally  effective  in 
the  AMCM  mission,  primarily  due  to  PNS 
deficiencies,  and  is  not  yet  operationally 
suitable.  Navy  efforts  to  improve  and  cor¬ 
rect  the  integrated  weapon  system  defi¬ 
ciencies  in  the  AMCM  mission  are  under¬ 
way. 


C/MH-53 


IV-3S 


CLOSE-IN  WEAPON  SYSTEM  Block  1 


SYSTEM  DESCRIPTION 


The  Close-In  Weapon  System  (CIWS) 
Block  1  is  a  rapid-fire  20  mm  gun  de¬ 
signed  for  close  range  defense  of  surface 
ships  against  antiship  missiles.  The  sys¬ 
tem  uses  a  search  radar  and  tracking  radar 
with  the  antennas  enclosed  in  a  radome  on 
top  of  the  gun  assembly.  After  the  search 
radar  detects  an  incoming  target,  the  track 
radar  locks  on  and  tracks  the  target. 
When  the  target  moves  within  a  predeter¬ 
mined  range,  the  gun  fires  projectiles 
made  of  depleted  uranium  or  tungsten  to 
provide  high  kinetic  energy  and  hardness 
to  penetrate  antiship  missiles.  The  track¬ 
ing  radar  then  detects  the  outgoing  stream 
of  projectiles  as  it  tracks  the  incoming  tar¬ 
get  and  moves  the  gun  barrel  to  minimize 


the  angular  difference  between  projectiles 
and  target,  thereby  bringing  the  projectile 
stream  onto  the  target.  This  process  is 
called  electronic  closed-loop  spotting. 
The  major  differences  between  the 
Block  1  version  of  CIWS  tested  and  the 
earlier  Block  0  version  include  an  ability 
to  search  for  threat  targets  higher  in  eleva¬ 
tion,  an  increased  magazine  capacity,  abil¬ 
ity  to  accommodate  higher  speed  targets, 
and  a  higher  firing  rate.  CIWS  provides  a 
new  capability  and  does  not  replace  any 
existing  system. 

BACKGROUND 

The  CIWS  Block  0  reached  initial  opera¬ 
tional  capability  (IOC)  in  1979.  The 
Block  0  system  was  designed  to  counter 
the  low-altitude  threats  of  the  late  1960s. 
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Accordingly,  it  was  designed  with  a  low 
seai  ch  elevation  coverage.  To  provide  ca¬ 
pability  against  current  threats  (diving  on 
ships  along  higher  approach  angles),  the 
Naval  Sea  Systems  Command  awarded  a 
contract  to  General  Dynamics,  Pomona,  in 
1978  to  develop  the  Block  1. 

Operational  Testing  of  the  Block  1  was 
conducted  in  three  phases.  The  third 
phase  (OT-IIC)  occurred  in  FY88.  OT-IIA 
took  place  at  the  Naval  Weapons  Center, 
China  Lake,  California  (June  1981  to  May 
1982).  The  Navy’s  operational  test  agency 
did  not  make  an  operational  assessment 
because  of  significant  differences  between 
test  and  operational  conditions  and  numer¬ 
ous  hardware  and  software  configuration 
changes.  The  second  phase,  OT-IDB,  was 
conducted  with  three  different  platforms: 
two  FFG-7  Oliver  Hazard  Perry  class  frig¬ 
ates  and  a  remotely  controlled  terminal- 
defense  test  ship  (a  decommissioned  de¬ 
stroyer)  during  the  period  from  February 
to  September  1985.  The  testing  with  the 
frigates  included  tracking  of  manned  air¬ 
craft  and  firings  against  towed  targets. 
Testing  with  the  terminal  defense  test  plat¬ 
form  included  live  firings  of  the  CIWS 
Block  1  against  a  missile  diving  toward 
the  platform  from  a  high  elevation  angle, 
a  low-altitude  drone,  and  towed  targets. 
Based  on  the  results  of  OT-UB,  production 
was  shifted  from  Block  0  to  Block  1. 

OT&E  ISSUES 

Operational  effectiveness  issues  addressed 
during  FY88  IOT&E  included  determining 
the  Block  1  capability  to  detect  air  threats 
throughout  its  expanded  search  volume; 
determining  capability  to  bring  effective 
fire  to  bear  on  supersonic  and  subsonic  air 
threats,  determining  capability  to  provide 
accurate  kill  assessment  and  timely  kill 
declaration;  determining  capability  to  shift 
to  the  next  engageable  air  threat  in  a 
timely  manner;  assessing  vulnerability;  de¬ 
termining  Block  1  capability  to  enhance 
survivability  of  the  defended  ship  relative 


to  Block  0;  and  determining  capability  of 
Block  1  to  detect  and  destroy  more  types 
of  threats  and  complete  more  engage¬ 
ments  than  Block  0  prior  to  reloading  the 
magazine 

Operational  suitability  issues  included 
the  determination  of  Block  1  reliability, 
maintainability,  a  /ailability,  logistic  sup- 
portability,  compatibility  with  the  operat¬ 
ing  environment,  interoperability,  training 
adequacy,  manning  adequacy,  safety, 
documentation  adequacy,  adequacy  of  the 
Integrated  Logistic  Support  Plan  and  the 
time  to  reload  from  Conditions  I  and  DI. 

OT&E  ACTIVITY 

Operational  testing  was  conducted  in  two 
phases.  The  first  phase  used  a  Block  1 
CIWS  on  the  remotely  controlled  test  ship. 
The  second  phase  used  the  USS  Josephus 
Daniels,  a  cruiser  of  the  Belknap  class,  as 
the  test  ship.  The  first  phase  was  dedi¬ 
cated  to  determining  operational  effective¬ 
ness  issues  in  as  realistic  an  environment 
as  possible.  The  second  phase,  conducted 
with  an  operational  ship,  was  dedicated  to 
determination  of  operational  suitability  is¬ 
sues. 

During  the  first  phase,  which  was  con¬ 
ducted  at  the  Pacific  Missile  Test  Center 
off  the  coast  of  Southern  California,  the 
test  ship  towed  a  decoy  barge  astern,  and 
the  targets  guided  toward  the  barge  which 
was  located  in  the  defended  zone  of  the 
CIWS.  Testing  was  conducted  against  both 
subsonic  and  supersonic  targets. 

The  second  phase  of  testing  with 
Josephus  Daniels  was  conducted  during 
fleet  exercises  with  a  battle  group  in  the 
Caribbean  operating  area  and  operating 
areas  off  the  Virginia  and  Florida  Coasts. 
Testing  included  aircraft  tracking,  and  in 
some  instances,  with  Josephus  Daniels 
simulating  utilization  of  her  own  passive 
defense  systems  to  decoy  the  simulated 
targets  “attacking”  her.  These  latter  tests 
were  intended  to  investigate  inter- 
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operability  issues  of  CIWS  with  other  on¬ 
board  systems.  Testing  also  included  live 
firing  against  tow  targets. 

OT&E  ASSESSMENT 

Limitations  during  the  FY88  operational 
testing  included  those  associated  with  tar¬ 
gets  and  weather  conditions.  The  avail¬ 
able  targets  did  not  fully  represent  the 
threats  in  some  operational  characteristics. 


Weather  conditions  were  those  encoun¬ 
tered  during  the  testing  period. 

It  is  our  view  that  the  FY88  operational 
testing  of  Block  1  CIWS  demonstrated  that 
the  system  does  provide  more  capability 
than  Block  0.  Results  of  FY88  operational 
testing  of  Block  1  CIWS  demonstrated  that 
it  is  operationally  suitable.  Based  on  the 
results,  it  is  our  view  that  continued  low- 
rate  production  is  justified,  but  capability 
in  certain  areas  should  be  pursued. 
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SYSTEM  DESCRIPTION 

The  E-2C  is  the  third  variant  of  a  carrier- 
based  airborne  early  warning  (AEW) /com¬ 
mand  and  control  system  developed  and 
produced  since  1956.  It  is  equipped  with 
an  airborne  tactical  data  system  which  in¬ 
cludes  both  active  and  passive  sensors. 
The  five-man  crew  interfaces  with  the 
data  processing  and  sensor  inputs  to  pro¬ 
vide  real-time  threat  warning  and  tactical 
analysis  to  the  battle  group  commander. 

The  Update  Development  Program  is 
composed  of  Group  I  and  Group  n  im¬ 
provements.  Group  I  consists  of  high¬ 
speed  processor  and  radar  improvements. 


Group  II  provides  the  radar  with  extended 
range,  environmental  processing,  and  an 
improved  Identification  Friend  or  Foe 
(IFF)  system.  The  T-56-A-427  engine 
upgrade  is  being  developed  in  parallel  and 
will  be  tested  with  Group  I  and  Group  n  in 
the  final  operational  evaluation. 


BACKGROUND 


The  E-2C  has  been  in  production  since 
1973.  A  previous  radar  upgrade  was  com¬ 
pleted  in  1977.  Developmental  tests  of 
Group  I  and  the  engine  were  completed  in 
Sept  1988.  The  operational  evaluation  of 
these  tests  is  scheduled  for  1989.  The  op- 
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erational  evaluation  of  the  Group  I  and  en¬ 
gine  upgrade  is  scheduled  for  1992. 

OT&E  ASSESSMENT 

No  dedicated  operational  tests  have  been 
conducted,  but  OTA  monitoring  and  re¬ 


views  of  developmental  tests  indicate  the 
Group  I  and  the  engine  upgrade  are  poten¬ 
tially  operationally  effective  and  poten¬ 
tially  operationally  suitable.  COMOPTEV- 
FOR  recommended  limited  production. 
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SYSTEM  DESCRIPTION 


The  F-14A  Tomcat  is  a  carrier-based, 
two-seat,  twin-engine,  auto  or  manual 
variable-sweep-wing  aircraft.  It  is  an  all- 
weather,  supersonic,  air-superiority 
fighter  capable  of  carrying  the  Phoenix, 
Sparrow,  and  Sidewinder  missiles  together 
with  an  internal  M-61  (20  millimeter)  gun 
for  fleet  air  defense  or  fighter  roles.  An 
air-to-ground  capability  is  secondary  and 
has  never  been  fully  developed.  Its  major 
subsystems  are  the  AWG-9  weapons  con- 
trol  system  (WCS)  and  two  TF30-P-414A 
engines.  The  AWG-9  is  a  software  pro¬ 
grammable  WCS  designed  to  detect  and 
track  multiple  airborne  targets  at  extended 
ranges  and  to  prepare  and  fire  the  air-to- 
air  missiles  and  M-61  cannon.  The 


AWG-9/Phoenix  missile  combination 
gives  the  F-14  the  ability  to  attack  up  to 
six  targets  nearly  simultaneously  at  long 
ranges. 

The  F-14A  Plus  (A+)  involves  an  engi¬ 
neering  change  proposal  (ECP)  to  replace 
the  current  TF-30  engine  with  the 
F110-GE-400,  a  derivative  of  an  Air 
Force  engine.  Associated  engine  accesso¬ 
ries,  structure,  hydraulic,  fuel  system  and 
ECS  modifications  will  be  incorporated,  as 
well  as  provisions  for  the  ALR-67  radar 
homing  and  warning  (RHAW)  system. 
The  F-14D  incorporates  the  same  engine 
and  associated  modifications  as  the  A+, 
but  also  includes  major  upgrades  through 
new  digitized  avionics  and  a  new  digital 
radar  (APG-71).  The  avionics  will  utilize 
a  modem  digital  multiplex  bus  architec- 
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ture  and  incorporate  state-of-the-art  avi¬ 
onics  equipment  such  as  JTIDS,  ASPJ,  and 
ERSTS.  The  APG-71  will  retain  the  high- 
peak-power  output  of  the  AWG-9  radar 
and  provide  for  signficiant  improvements 
in  ECCM  capability,  reliability,  and  main¬ 
tainability.  The  F~14D’s  weapons  capabil¬ 
ity  will  increase  to  include  AMRAAM, 
HARM,  and  Harpoon. 

BACKGROUND 

The  F-14A  first  flew  in  December  1970 
and  became  fleet  operational  in  December 
1973.  In  July  1983,  a  memorandum  from 
the  Secretary  of  the  Navy  delineated  the 
required  capabilities  for  an  upgraded 
F-14A,  the  F-14D.  The  need  for  an 
early,  limited  upgrade,  the  F-14A+,  was 
determined  to  be  necessary  due  to  safety 
and  operability  problems  associated  with 
the  TF-30  engine.  In  September  1986,  the 
Secretary  of  the  Navy  directed  that  the 
procurement  of  new  production  F-14Ds 
would  be  supplemented  by  remanufactur¬ 
ing  F-14A/A+S  into  F-14Ds.  Significant 
OT&E  of  the  F-14A  is  completed.  Cur¬ 
rent  activity  consists  of  OT&E  of  the  op¬ 
erational  flight  program  (OFP).  The  OFP 
is  the  software  for  the  AWG-9  weapons 
control  system  (WCS).  The  F-14A+  is 
currently  in  operational  test.  The  F-14D 
(avionics/radar)  first  flight  took  place  on 
November  23,  1987.  Testing  to  date  has 
centered  on  radar  developmental  testing 
using  an  APG-71  radar  installed  in  a  Pa¬ 
cific  Missile  Test  Center  (PMTC)  A-3  test 
aircraft,  and  avionics  development  and  ra¬ 
dar  integration  using  full-scale  develop¬ 
ment  F-14D  aircraft.  The  F-14D  com¬ 
pleted  its  first  phase  of  OT  in  September 
1988. 

OT&E  ISSUES 

The  combined  F-14A  and  F-14A+OT  is¬ 
sues  were  the  operational  effectiveness 
and  suitability  of  OFP  114C/P14C.  The 
major  OFP  changes  concerned  the  fatigue 
engine  monitoring  system  (FEMS)  associ¬ 


ated  with  the  F110-GE-400  engine,  the 
ALR-67  interface,  the  ALQ-126B  (defen¬ 
sive  electronic  countermeasures  system) 
interface,  and  the  AWG-15F  (integrated 
armament  control  system)  interface. 

The  F-14A+  test  issues  were  to  assess 
the  operational  effectiveness  of  the 
F-14A+  in  the  maritime  air  superiority 
(MAS),  strike  escort,  and  tactical  air  re¬ 
connaissance  pod  system  (TARPS)  mis¬ 
sions  while  operating  in  the  carrier  or  land 
base  environments.  The  suitability  test  is¬ 
sues  were  reliability,  maintainability, 
availability,  logistic  supportability,  com¬ 
patibility,  interoperability,  training,  docu¬ 
mentation,  human  factors,  and  safety. 

The  F-14D  OT-IIA  critical  operational 
issues  (COIs)  were  intended  for  partial 
resolution  due  to  the  early  stage  of  test. 
These  COIs  were  weapon  system  perform¬ 
ance,  reaction  time,  standoff  detection, 
identification  and  engagement  capabilities, 
command  and  control,  weapons  manage¬ 
ment,  compatibility,  interoperablity,  hu¬ 
man  factors,  safety,  and  built-in  test 
(BIT). 

OT&E  ASSESSMENT 

OFP  114C/P14C.  Concurrent  DT/OT  was 
conducted  from  November  2  to  December 
28,  1987.  Dedicated  OT  occurred  from 
December  29,  1987  to  April  1,  1988.  A 
total  of  180  sorties  and  293.4  flight  hours 
were  flown  in  the  F-14A  and  F-14A+  dur¬ 
ing  the  two  test  phases.  Sorties  were 
flown  in  the  maritime  air  superiority 
(MAS),  power  projection,  carrier  opera¬ 
tions,  and  reconnaissance  mission  areas. 
OFP  1 14C/P14C  was  assessed  as  opera¬ 
tionally  effective  and  suitable  and  released 
to  the  fleet  in  May  1988.  A  DOT&E  staff 
member  has  flown  the  F-14A  with  OFP 
114C/P14C. 

F-14A+.  OT-IV  of  the  F-14A+  com¬ 
menced  in  July  1988  and  is  still  under 
way.  The  delays  have  been  caused  by  de¬ 
ficiencies  in  the  engine  clearance  and  the 
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engine/gear  box  turnbuckle  mounting  link. 
A  DOT&E  staff  member  flew  the  F-24A+ 
simulator  and  flew  a  performance  com- 

?arison  against  the  F-14A+  in  the  F-14A. 

he  performance  comparison  consisted  of 
a  side-by-side  acceleration  and  a  simu¬ 
lated  air-to-air  engagement. 

F-14D.  OT-DA  began  on  August  22, 
1988,  and  was  completed  on  September  1, 
1988.  OT-HA  was  an  early  look  at  poten¬ 
tial  operational  effectiveness  and  suitabil¬ 
ity  utilizing  full-scale  developmental 
(FSD)  models  of  the  F-14D.  The  radar 
and  avionics  software  maturity  was  ap¬ 
proximately  15  percent  complete.  Radar¬ 
mode  selection  was  limited  and  no  defen¬ 
sive  electronic  countermeasures  (DECM) 
equipment  was  installed.  Test  limitations 
included:  a  limited  number  of  radar  inter¬ 
cepts  precluding  a  determination  of  90 
percent  probability  of  detection  range;  air¬ 
space  restrictions;  low  altitude  safety  of 
flight  restrictions  for  the  target  aircraft; 
F-14D  FSD  aircraft  not  cleared  for  night 
or  instrument  meteorological  conditions 
(IMC)  flight;  and  system  contractor  main¬ 
tenance  and  logistics  support. 

Twenty-six  sorties  were  flown  in  OT- 
DA.  All  critical  operational  issues  were 


partially  resolved.  The  F-14D  was  as¬ 
sessed  to  be  potentially  operationally  ef¬ 
fective  and  potentially  suitable.  Some  ar¬ 
eas  identified  for  i  rection  (normal  for 
an  early  phase  of  te^t)  prior  to  the  next 
phase  of  OT  are:  (1)  safety  issues  associ¬ 
ated  with  the  head-up  display  (HUD)  and 
vertical  display  indicator  (VDI);  (2)  per¬ 
formance  issues  associated  with  the  range 
while  search  (RWS)  and  pulse  doppler 
search  (PDS)  radar  modes;  (3)  human  fac¬ 
tors  issues  regarding  display  readability, 
lighting,  and  mode  selection  capability; 
and  (4)  excessive  BIT  false  alarm  rate  of 
the  onboard  checkout  (OBC)  continuous 
monitor. 


SUMMARY 

The  F-14A  is  a  mature  weapons  system 
which  is  undergoing  minor  modifications 
and  updates  during  FOT&E.  Major 
changes  and  improvements  to  the  F-14 
(F-14A+  and  F-14D)  began  in  FY88.  The 
F-14A+  is  still  in  test,  pending  resolution 
of  the  carrier  suitability  issue.  The  F-14D 
completed  its  first  phase  of  OT,  an  early 
operational  test,  and  is  assessed  to  be  po¬ 
tentially  operationally  effective  and  poten¬ 
tially  operationally  suitable. 
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SYSTEM  DESCRIPTION 

The  F/A-18  A  Hornet  is  a  single-seat, 
twin-engine,  carrier-based  strike  fighter. 
It  was  designed  to  replace  the  F-4  and 
A-7,  and  is  being  employed  in  the  Navy 
strike  fighter  squadrons  and  Marine 
fighter  attack  squadrons.  It  has  an  inter¬ 
nally  moutned  M-61  (20  millimeter)  gun, 
carries  the  Sparrow  and  Sidewinder  mis¬ 
siles  in  the  air-to-air  role,  and  various  nu¬ 
clear  and  non-nuclear  air-to-ground 
weapons  in  the  strike  role.  It  is  also  capa¬ 
ble  of  dropping  most  air-deliverable 
mines.  The  aircraft  incorporates  a  digital 
control-by-wire  flight  control  system, 
multiplexed  digital  avionics  and  weapons 
control  system  and  the  APG-65  radar.  It 
is  powered  by  two  F404-GE-400  engines. 


The  F/A-18C  involves  major  upgrades  to 
the  F/A-18  A.  These  changes,  grouped 
under  engineering  change  proposal  (ECP) 
178,  include  provisions  for  new  hardware 
systems  with  the  associated  software  for 
ASPJ,  AMRAM,  IIR  Maverick,  and  the 
flight  incident  recorder  and  aircraft  moni¬ 
tor  system  (FERAMS).  Other  changes  in¬ 
corporated  are  a  left/right  fuel  system 
(ECP- 162)  and  an  improved  environ¬ 
mental  control  system  (ECP-35),  which  is 
not  unique  to  the  F/A-18C.  Night  attack, 
tactical  reconnaissance  and  tactical  air 
controller  (airbome)/forward  air  controller 
(airborne)  TAC(A)/FAC(A))  capabilities 
will  be  added  in  future  F/A-18D’s.  The 
F/A-18B  and  F/A-18D  respectively,  are 
the  two-seat  variants  of  the  F/A-18A  and 
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F/A-18C.  These  versions  are  currently 
being  used  for  training  only. 

BACKGROUND 


The  F/A-18  first  flew  in  November  1978 
and  completed  OPEVAL  in  October  1982. 
IOC  was  declared  in  March  1983.  Fol¬ 
low-on  operational  test  and  evaluation 
(FOT&E)  of  discrepancies  discovered  dur¬ 
ing  OPEVAL  and  of  the  electronic  warfare 
(EW)  suite/HARM  missile  (not  available 
for  OPEVAL)  was  completed  by  August 
1985.  A  program  management  proposal 
(PMP),  which  was  approved  by  the 
Secretray  of  the  Navy  in  January  1985, 
combines  several  new  subsystems  and  im¬ 
provements  into  a  single  block  upgrade  as 
part  of  an  overall  preplanned  product  im¬ 
provement  (P3I)  program.  Due  to  the  sig¬ 
nificant  changes  in  system  capabilities  re¬ 
sulting  from  this  P3I,  the  model 
designation  was  changed  from  F/A-18  A  to 
F/A-18C/D,  beginning  with  Lot  X  aircraft. 
However,  because  the  Lot  X  aircraft  retain 
the  XN-5  mission  computer  of  the  Lot  IX 
and  previous  aircraft,  they  are  not  cur¬ 
rently  compatible  with  ASPJ,  AMRAAM, 
and  DR  Maverick.  The  F/A-18  with  the 
87X  operational  flight  program  (OFP) 
completed  OT&E  in  June  1988.  The  OFP 
associated  with  the  aircraft’s  mission  com¬ 
puters,  inertial  navigation  system  (INS), 
and  stores  management  set  (SMS)  re¬ 
ceives  periodic  updates  which  undergo  de¬ 
velopmental  and  operational  testing.  OFP 
87X  is  the  follow-on  software  to  the  85A+ 
OFP. 


OT&E  ISSUES 


Operational  testingof  the  87X  operational 
filght  program  (OFP)  addressed  the  opera¬ 
tional  effectiveness  and  suitability  of  87X, 
including  correction  of  previously  identi¬ 
fied  deficiencies,  in  the  F/A-18A  and 
F/A-18C.  Included  in  this  operational  test 
was  an  assessment  of  the  operational  ef¬ 


fectiveness  and  suitability  of  Lot  X 
F/A-18C  aircraft.  Critical  operational  is¬ 
sues  included  the  total  system  perform¬ 
ance  in  the  mission  areas  of  maritime  air 
superiority  (MAS),  war  at  sea  (WAS), 
power  projection,  air  combat  maneuvering 
(ACM),  defense  suppression,  close  air 
support  (CAS),  and  deep  air  support.  In¬ 
cluded  in  these  issues  were  individual  as¬ 
sessments  of  sensor  performance  (e.g.,  ra¬ 
dar  and  noncooperative  target  recognition 
(NCTR)),  XN-5  mission  computer  per¬ 
formance,  air-to-air  missile  capability, 
air-to-ground  weapon  accuracy,  and  sur¬ 
vivability.  The  suitability  issues  were 
reliablity,  availability,  maintainability 
(RAM);  logistic  supportability;  compatibil¬ 
ity;  interoperablity;  training;  safety;  docu¬ 
mentation;  and  human  factors. 

OT&E  ASSESSMENT 

Operational  testing  of  the  87X  OFP  and 
Lot  X  F/A-18C  aircraft  was  conducted  at 
NWC  China  Lake,  California;  PMTC, 
Point  Mugu,  California;  Edwards  AFB, 
California;  NAS  Miramar,  California;  Nel¬ 
lis  AFB,  Nevada;  NAS  Fallon,  Nevada; 
Luke  AFB,  Arizona;  MCAS  Yuma,  Ari¬ 
zona;  Eglin  AFB,  Florida;  and  NWEF 
Kirtland  AFB,  New  Mexico.  Carrier-base 
operations  were  accomplished  on  board 
USS  Carl  Vinson  (CVN-70).  Testing  con¬ 
sisted  of  402  sorties  and  559.6  flight 
hours. 

Limitations  to  scope  of  testing  in¬ 
cluded:  (1)  the  Mk-50  and  Mk-60  series 
mines,  the  GBU-78/B  Gator,  and  the 
BLU-88  Bigeye  were  not  tested  for  air-to- 
ground  weapon  accuracy;  and  (2)  the 
FUR  pod,  laser  tracker  designator/ranging 
(LTD/R)  pod,  and  F/A-18D  aircraft  were 
not  available  for  testing. 

The  F/A-18A  with  the  87X  OFP  exhib¬ 
ited  no  degradation  of  operational  effec¬ 
tiveness  or  operational  suitability  as  com¬ 
pared  to  an  F/A-18A  with  the  85A+  OFP. 
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The  test  found  the  87X  OFP  operationally 
effective  and  operationally  suitable. 


The  F/A-18C  with  the  87X  OFP  exhib¬ 
ited  no  degradation  of  operatonal  effec¬ 
tiveness  as  compared  to  an  F/A-18A. 
However,  the  F/A-18C  did  not  meet  the 
unrefueled  on-station  loiter  time  for  the 
MAS  mission  or  the  unrefueled  range  for 
the  power  projection  and  deep  air  support 
missions.  The  F/A-18A  and  F/A-18C 
rate  of  fuel  consumption  and  ranges  for 
these  mission  scenarios  were  essentially 
identical.  This  matches  the  results  of  the 
F/A-18A  OPEVAL  in  May  to  October 
1982  (and  F/A-18A  FOT&E),  which  re¬ 
sulted  in  a  recommendation  either  to  in¬ 
crease  the  F/A-18  fuel  capacity  or  in¬ 
crease  embarked  air  wing  tanking  assets. 
Significant  deficiencies  in  the  operational 
suitability  of  the  F/A-18C  were  noted  in 
documentation  and  human  factors.  Main¬ 


tenance  publications  were  inadequate,  par¬ 
ticularly  for  the  fuel  system,  electrical  sys¬ 
tem,  and  environmental  control  system. 
'This  inadequacy  resulted  in  extended 
maintenance  times.  The  integrated  fuel 
and  engine  indicator  (IFEI)  was  difficult  to 
read.  It  did  not  permit  the  monitoring  of 
all  fuel  settings  simultaneously,  and  it  was 
difficult  to  use.  Therefore,  the  F/A-18C 
with  the  87X  OFP  is  assessed  to  be  opera¬ 
tionally  effective  and  potentially  operation¬ 
ally  suitable. 

SUMMARY 

Continued  updates  of  the  OFP  are 
planned.  They  will  correct  deficiencies 
and  accommodate  improved  capabilities 
and  upgrades  to  the  F/A-18.  OT&E  of  the 
F/A-18  weapons  system  integration  (e.g., 
ASPJ  and  AMRAAM)  is  scheduled  for 
March  1989  in  conjunction  with  89X  OFP 
testing. 
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SYSTEM  DESCRIPTION 

The  mission  of  the  FFG-7  class  guided 
missile  frigate  is  to  provide  self-defense 
and  supplement  planned  and  existing  es¬ 
corts  effectively  in  the  protection  of  under¬ 
way  replenishment  groups,  amphibious 
forces,  and  military  shipping  against  sub¬ 
surface,  air  and  surface  threats.  The 
original  (FY75)  combat  system  suite  on 
this  class  is  being  upgraded  on  FY79  and 
later  year  ships  to  include  the  Light  Air¬ 
borne  Multi-Purpose  System  (LAMPS) 
Mk  ID,  a  tactical  towed  array  sonar  (TAC- 
TAS)  AN/SQR-19,  Naval  Tactical  Data 
System  (NTDS  Link  11),  and  the  inte¬ 
grated  electronics  warfare  support  meas¬ 
ures  (ESM)  AN/SLQ-32(V)2.  The  FY75 
combat  system  provides  only  short  range 


antisubmarine  warfare  (ASW)  capability 
and  lacks  full  NTDS.  The  FY79  combat 
system  provides  both  long-and  short- 
range  ASW  sensor  and  weapon  systems 
capability  as  well  as  full  NTDS  capability. 
The  FY84  combat  system  improvement 
will  provide  enhanced  anti-air  warfare 
(AAW)  capability. 

BACKGROUND 

The  guided  missile  frigate  (FFG)  program 
entered  the  conceptual  phase  in  January 
1971.  The  ship  system  design  was  com¬ 
pleted  in  April  1973.  Contracts  for  detail 
design  and  construction  of  the  lead  ship 
were  awarded  to  Bath  Iron  Works  in  1973 
and  the  lead  ship  of  the  class,  USS  Oliver 
Hazard  Perry  (FFG-7),  was  delivered  to 
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the  Navy  in  November  1977.  The  fifty- 
first  and  final  ship  was  delivered  to  the 
Navy  in  November  1988.  The  final  ship  of 
this  class,  USS  Ingraham  (FFG-61),  will 
be  equipped  with  the  FY84  combat  system 
which  will  undergo  FOT&E  during  FY91. 
(Four  ships  of  the  class  with  the  FY75 
combat  system  have  been  built  for  Austra¬ 
lia.) 

Operational  Evaluation  (OPEVAL)  of 
the  FFG-7  baseline  combat  system  was 
conducted  at  the  combat  system  test  cen¬ 
ter  (CSTC)  Ronkonkoma,  New  York,  in 
1975.  Follow-on  operational  test  and 
evaluation  (FOT&E)  was  conducted  in 
1977  at  the  CSTC  and  in  1980  on  board 
USS  Oliver  Ha2ard  Perry. 

Additional  operational  testing  of  the 
FFG-7  combat  system  was  not  conducted 
until  July  1987  when  the  first  ship  with  the 
FY79  combat  system,  USS  Elrod 
(FFG-55),  became  the  test  ship  for 
FOT&E.  Test  results  were  not  completely 
analyzed  in  time  to  be  included  in  our 
FY87  Annual  Report  and  are  reported 
here. 

OT&E  ISSUES 

The  principal  issues  addressed  in  the 
FOT&E  of  the  FY79  combat  system  were: 
(1)  the  capability  of  the  system  to  provide 
self-protection  and  protection  of  under¬ 
way  replenishment  groups,  amphibious 
forces,  and  military  shipping  against  sub¬ 
marine,  air,  and  surface  threats  in  single 
and  multi-threat  environments;  (2)  the  ca¬ 
pability  of  the  system’s  command,  control, 
and  communications  subsystems  to  fully 
sustain  the  assigned  mission  areas  in  inde¬ 
pendent  and  coordinated  operations;  and 
(3)  the  capability  of  the  system’s  elec¬ 
tronic  warfare  subsystem  to  support  the 
ship’s  ability  to  carry  out  its  mission. 


OT&E  ACnVITY 

As  reported  in  the  FY87  annual  report, 
FOT&E  of  the  FFG-7  FY79  combat  system 
was  conducted  onboard  USS  Elrod 
(FFG-55)  during  July-August  1987 
(analysis  of  results  was  not  complete  when 
our  FY87  Annual  Report  was  published). 
Testing  was  conducted  in  the  Atlantic 
Fleet  Weapons  Training  Facility  (Puerto 
Rico)  area,  in  the  Jacksonville,  Florida, 
operating  area  and  in  the  Western  Atlantic 
operating  area  during  July.  This  was  sup¬ 
plemented  by  observations  by  the  COM- 
OPTEVFOR  operational  test  director  dur¬ 
ing  Elrod's  participation  in  a  fleet  exercise 
in  August  (Phase  3).  A  DOT&E  staff 
member  observed  the  entire  phase  of  test¬ 
ing  conducted  in  the  Puerto  Rico  operating 
area.  This  was  the  only  phase  during 
which  live  ordnance  was  fired;  simulated 
attacks  were  also  conducted  by  manned 
aircraft. 

The  Phase  1  period  tested  the  combat 
system  in  the  AAW,  ASUW,  and  ASW 
warfare  areas.  During  this  phase,  Elrod 
simulated  firing  ordnance  at  the  targets. 
AAW  testing  included  simulated  attacks 
on  Elrod  by  manned  aircraft,  during  which 
Elrod  attempted  to  detect,  establish  fire 
control  radar  tracking  with  the  Mk  92  fire 
control  system,  and  simulate  missile  or 
gun  system  firing  against  the  aircraft. 
Phase  1  ASW  and  ASUW  testing  utilized 
a  fleet  submarine  as  the  "target,”  with 
ASW  surveillance  assistance  provided  by  a 
P-3C  aircraft  deploying  and  monitoring 
sonobuoys. 

Phase  2  testing  was  conducted  in  the 
Puerto  Rican  operating  area  and  included 
operational  testing  in  the  areas  of  AAW, 
ASW,  and  ASUW.  Target  drones  were 
presented  to  be  engaged  by  Standard  mis- 
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siles  during  AAW  testing,  and  manned  air¬ 
craft  conducted  simulated  attacks  against 
Elrod  in  some  cases.  In  these  latter  in¬ 
stances,  Elrod  was  to  detect,  track,,  estab¬ 
lish  fire  control  solutions  and  simulate 
missile  launch.  In  some  cases,  the  testing 
included  multiple  warfare  areas:  simulta¬ 
neous  AAW  and  ASW.  Mk  46  exercise 
torpedoes  were  launched  at  ASW  targets. 

Limitations  to  testing  included  the  dif¬ 
ferences  between  available  targets  and  ac¬ 
tual  threats,  with  the  former  presenting 
considerably  less  stringent  environments 
than  expected  with  the  latter.  The 
SQS-56  sonar  was  operated  in  degraded 
mode.  Actual  simultaneous  engagements 


in  all  three  warfare  areas  (AAW/ASUW/ 
ASW)  were  not  achieved.  All  surface-to- 
surface  missile  engagements  were  simu¬ 
lated. 

OT&E  ASSESSMENT 

As  a  result  of  the  FY87  operational  testing 
the  FFG-7  FY79  Combat  System  is  consid¬ 
ered  marginally  operationally  effective  in 
ASW  and  marginally  operationally  effec¬ 
tive  in  command,  control,  and  communi¬ 
cations  capability  in  single-mission  war¬ 
fare  areas.  The  FFG-7  FY79  Combat 
System  is  considered  potentially  operation¬ 
ally  suitable. 
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SYSTEM  DESCRIPTION 

The  Fixed  Distributed  System  (FDS)  will 
be  an  Anti-Submarine  Warfare  (ASW) 
surveillance  system  using  clusters  of 
hydrophones  distributed  on  the  ocean 
floor  to  gather  acoustic  data. 

BACKGROUND 

A  FDS  test  bed  which  uses  current  surveil¬ 
lance  hardware  was  installed  in  an  ocean 
area  to  validate  the  FDS  concept.  The 
program  has  been  in  the  demonstration 
and  validation  phase  and  is  approaching  a 
Milestone  II  decision  (approval  for  full- 
scale  development,  including  authorization 
to  acquire  an  engineering  development 
model)  in  1989.  This  very  early  opera¬ 
tional  test  and  evaluation  was  conducted 


to  test  the  FDS  concept  and  provide  the 
Defense  Acquisition  Board  (DAB)  more 
information  for  its  deliberations  at  that  de-  • 
cision  point. 

OT&E  ISSUES 

The  major  OT&E  issue  addressed  during 
the  FY88  testing  was  assessment  of  the  ca¬ 
pability  of  the  FDS  concept  utilizing  dem¬ 
onstration/validation  phase  test  bed  hard¬ 
ware  and  software. 

OT&E  ACTIVITY 

Commander,  Operational  Test  and  Evalu¬ 
ation  Force  (COMOPTEVFOR)  conducted 
initial  operational  test  and  evaluation 
(IOT&E)  during  mid-September  1988,  us¬ 
ing  the  FDS  test  bed  to  assess  the  opera¬ 
tional  issue  as  described  above.  Because 
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this  program  is  at  such  an  early  point  in 
the  acquisition  cycle,  there  are  no  schools 
in  place  to  train  operators  in  the  use  of  its 
unique  equipment.  Consequently,  con¬ 
tractor  representatives  who  are  still  modi¬ 
fying  the  software  instructed  operators 
during  the  testing.  A  DOT&E  staff  mem¬ 
ber  observed  the  testing  from  the  shore- 
based  test  bed  facility. 


SUMMARY 

Test  limitations  resulted  primarily  from 
the  immaturity  of  the  FDS  test  bed.  Al¬ 


though  these  limitations  will  have  some 
impact  on  resolution  of  critical  operational 
issues,  this  was  an  opportunity  to  opera¬ 
tionally  test  the  FDS  concept.  Results  of 
this  testing  are  being  analyzed  and  will  be 
reported  in  the  DOT&E  FY89  Annual  Re¬ 
port. 
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poon. 

The  Harpoon  weapon  system  is  an 
antiship  weapon  system  designed  for  em-  BACKGROUND 
ployment  from  air,  surface,  and  subma¬ 
rine  launch  platforms.  The  surface-and  The  Harpoon  initial  operational  evalu- 

submarine-launched  missiles  utilize  a  ations  were  conducted  from  1975  to  1977 

booster  to  attain  flight  speed.  All  missiles  on  an  FF-1052  class  ship,  P-3  aircraft, 

use  a  turbojet  sustainer  engine  to  maintain  and  an  SSN-594  class  submarine.  Har- 

speed  and  cruise  altitude  to  maximum  poon  was  evaluated  as  operationally  effec- 

range.  An  active  radar  seeker  provides  tive  but  not  operationally  suitable  due  to 

target  acquisition  and  terminal  homing.  failure  to  meet  reliability  thresholds.  Af- 

The  Block  1C  variant  of  Harpoon  has  in-  ter  production  process  improvements  and 

creased  tactical  flexibility.  follow-on  OT&E,  Harpoon  was  approved 

for  full  production  in  1981.  Additional 
Each  launch  platform  has  a  unique  FOT&E  was  conducted  between  1977  and 

combat  system,  which  provides  engage-  1981  to  evaluate  the  canister  launcher, 

ment  planning,  missile  initialization,  and  Harpoon  Block  1  missile  seeker  improve- 

launch  control  of  Harpoon.  These  plat-  ments,  a  sea-skim  trajectory  improvement 
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developed  by  the  United  Kingdom  and  the 
Harpoon  weapon  system  installed  on  A-6E 
aircraft. 

In  1983  the  Harpoon  Block  1C  missile 
was  operationally  tested  on  various  launch 
platforms.  Tests  determined  that  the  mis¬ 
sile  was  potentially  operationally  effective 
and  suitable.  In  1985  the  Block  1C  mis¬ 
sile  and  AN/SWG-1A(V)  Harpoon  Ship 
Command  and  Launch  Control  Set 
(HSCLCS)  were  operationally  tested  from 
a  destroyer  and  determined  to  be  poten¬ 
tially  operationally  effective  and  suitable. 
As  we  reported  last  year,  1987  operational 
testing  included  an  evaluation  of  the  Tar- 
tar/ASROC  variant  Harpoon  Block  1C 
missile  and  the  AN/SWG-1A(V) 
HSCLCS.  Both  the  Block  1C  missile  and 
the  AN/SWG~1A(V)  HSCLCS  were  deter¬ 
mined  to  be  potentially  operationally  ef¬ 
fective  and  suitable.  The  Block  1C  missile 
seeker  was  also  operationally  tested  during 
1987.  It  was  determined  to  be  potentially 
operationally  effective  and  suitable. 

OT&E  ISSUES 

OT&E  issues  investigated  during  FY88  op¬ 
erational  testing  included  operational  test¬ 


ing  included  operational  effectiveness  and 
suitability  of  the  AN/SWG-lAfV) 
HSCLCS  canister  variant  with  the  graphic 
display  processor  and  data  processing 
computer  software.  Specifically,  the  FY88 
testing  focused  on  the  capability  of  the 
HSCLCS  and  operator  to  prepare  missiles 
for  flight.  Suitability  issues  included  logis¬ 
tic  supportability,  interoperability,  human 
factors,  safety,  and  both  availability  and 
adequacy  of  tactics  for  HSCLCS  employ¬ 
ment. 

OT&E  ACTIVITY 

FY88  operational  testing  was  conducted 
January-August  1988  with  two  different 
DDG-993  class  destroyers,  USS  Callaghan 
and  USS  Chandler ,  in  the  southern  Cali¬ 
fornia  operating  area.  Testing  consisted 
of  simulated  firings  of  Harpoon  missiles. 
Results  of  this  testing  are  being  analyzed 
and  will  be  reported  in  the  FY89  DOT&E 
Annual  Report. 
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The  Light  Airborne  Multi-Purpose  System 
(LAMPS)  Mk  El  is  a  computer  integrated 
ship/helicopter  system  designed  to  in¬ 
crease  the  effectiveness  of  surface  com¬ 
batants.  It  uses  the  SH-60B  SEAHAWK 
helicopter  which  carries  sonobuoys,  torpe¬ 
does,  acoustic  processors,  and  Magnetic 
Anomaly  Detection  (MAD)  equipment  for 
its  antisubmarine  warfare  (ASW)  mission. 
Its  radar  and  electronic  support  measures 
(ECM)  equipment  are  used  in  its  other  pri¬ 
mary  mission,  antiship  surveillance  and 
targeting  (ASST).  The  various  classes  of 
ships  which  employ  LAMPS  Mk  in 
(DD-963,  DDG-993,  FFG-7,  CG-47)  pro¬ 
vide  additional  sensor  processing,  com- 


LIGHT  AIRBORNE  MULTI¬ 
PURPOSE  SYSTEM  (LAMPS) 
MK  III 


mand  and  control,  landing  and  traversing 
systems,  and  maintenance  and  support  fa¬ 
cilities,  as  well  as  integrate  LAMPS  infor¬ 
mation  with  other  sensor  data.  LAMPS 
Mk  m  secondary  missions  include  search 
and  rescue,  medical  evacuation,  vertical 
replenishment,  communications  relay,  lo¬ 
gistics  support,  and  naval  gunfire  support. 


BACKGROUND 


The  LAMPS  Program  was  initiated  in  1969 
based  on  a  CNO  requirement  for  a 
manned  helicopter  to  operate  from  de¬ 
stroyer-class  ships  to  enhance  their  ASW 
and  ASST  capabilities.  The  LAMPS  Mk  I 
was  the  initial  result  of  this  requirement, 
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with  the  LAMPS  Mk  III  being  the  follow- 
on  version. 

The  LAMPS  Mk  DI  validation  phase 
was  completed  in  December  1976  and  the 
first  flight  of  the  SH-60B  was  conducted 
in  December  1979.  A  full-scale  develop¬ 
ment  model  was  used  for  OT&E 
(OPEVAL)  in  the  stand-alone  mode 
aboard  USS  Mclnerney  (FFG-8)  from  May 
1981  through  February  1982.  The  LAMPS 
Mk  m  was  determined  to  be  potentially 
operationally  effective  and  potentially  op¬ 
erationally  suitable.  Provisional  approval 
for  service  use  was  granted  in  September 
1981,  and  the  first  production  aircraft  was 
delivered  in  September  1983.  Follow-on 
operational  test  and  evaluation  (FOT&E) 
(OT-  mA/B)  resulted  in  the  Navy’s  inde¬ 
pendent  operational  test  agent.  Com¬ 
mander,  Operational  Test  and  Evaluation 
Force  (COMOPTEVFOR)  concluding  that 
the  LAMPS  Mk  IE  was  potentially  opera¬ 
tionally  effective  and  operationally  suit¬ 
able,  and  recommending  limited  fleet 
introduction.  Open-ocean  ASW  effec¬ 
tiveness  could  not  be  determined  due  to 
cancellation  of  this  phase  of  testing. 

In  July  and  August  1987,  FOT&E  (OT- 
EIC)  was  conducted  to  evaluate  open- 
ocean  ASW  effectiveness  and  other  out¬ 
standing  OT&E  issues  as  well  as  verify 
correction  of  deficiencies  noted  in  earlier 
operational  tests.  The  testing  was  con¬ 
ducted  onboard  USS  Elrod  (FFG-55)  at  in¬ 
strumented  ASW  and  electronic  warfare 
(EW)  ranges,  as  well  as  during  a  fleet  ex¬ 
ercise.  COMOPTEVFOR  concluded  that 
the  LAMPS  Mk  IE  weapon  system  was  op¬ 
erationally  effective  and  operationally  suit¬ 
able,  and  recommended  full  fleet  introduc¬ 
tion  upon  correction  of  automatic 
bladefold  system  deficiencies. 

FOT&E  (OT-EID)  on  a  production 
LAMPS  Mk  El  using  Fleet  Issue  (FI)  soft¬ 
ware  1.18.1  was  conducted  from  shore 
based  facilities  and  USS  Halyburton 
(FFG-40)  in  FY  88.  FI  1.18.1  is  an  in¬ 


terim  software  release  designed  to  fulfill 
the  need  for  ESM  helicopter  threat  warn¬ 
ing  (HTW).  HTW  incorporates  new  auto¬ 
matic  airborne  ESM  threat  processing  and 
an  enhanced  display  of  identified  threat 
emitters. 

Operational  effectiveness  issues  exam¬ 
ined  in  OT-JED  included:  ASW  redetec¬ 
tion,  classification,  localization  and  attack 
capability;  ASST  capability;  and  surviv¬ 
ability.  The  operational  suitability  issues 
addressed  included:  reliability,  maintain¬ 
ability,  availability,  logistics  suppor- 
tability,  human  factors,  and  inter¬ 
operability. 

OT&E  ASSESSMENT 

OT-EID  v/as  conducted  in  two  phases. 
The  first  phase  was  conducted  in  Decem¬ 
ber  1987  from  Haylburton  during  a  fleet 
exercise  to  assess  the  ASW  effectiveness 
and  suitability  issues.  The  second  phase 
of  testing  was  conducted  from  January  to 
February  1988,  using  the  Chesapeake  Test 
Range  (CTR)  to  assess  ASST  effective¬ 
ness.  The  testing  was  limited  in  that  the 
equipment  on  USS  Haylburton  (FFG-7 
class)  is  not  the  same  as  that  on  the  other 
ship  classes,  and  therefore,  an  assessment 
of  the  FI  1.18.1  capabilities  when  inte¬ 
grated  with  CG-47,  DD-963,  and  DD-993 
class  ships  could  not  be  made.  FI  1.18.1 

{>erformance  appeared  to  be  directly  re- 
ated  to  the  type  and  number  of  computer 
functions  selected  simultaneously.  Proc¬ 
essing  degradation  was  most  apparent  in 
the  multi-mission  scenario.  System  faults 
and  software  system  slowdowns  affected 
the  televance  of  tactical  data  available  to 
the  operator,  impacting  mission  success. 
The  Navy’s  independent  operational  test 
agent,  Commander,  Operational  Test  and 
Evaluation  Force  (COMOPTEVFOR),  con¬ 
cluded  that  the  LAMPS  Mk  IB  weapon  sys¬ 
tem  using  FI  1.18.1  was  potentially  opera¬ 
tionally  effective  and  potentially 
operationally  suitable.  COMOPTEVFOR 
recommended  that  fleet  use  of  1.18.1  soft¬ 
ware  be  withheld  until  the  computer 
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faults,  software  system  slowdowns,  and 
display  degradation  problems  are  cor¬ 
rected. 

SUMMARY 

The  interim  FI  1.18.1  software  release  for 
the  LAMPS  Mk  IH  is  potentially  operation¬ 


ally  effective  and  potentially  operational 
suitable.  A  non-interim  software  release, 
FI  1.19.1,  is  in  development  and  will  be 
evaluated  in  future  FOT&E. 


LIGHT  AIRBORNE  MULTI¬ 
PURPOSE  SYSTEM  (LAMPS) 
MK  III 
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SYSTEM  DESCRIPTION 


The  LRAACA  represents  the  new  aircraft 
with  the  capability  to  meet  the  ASW  threat 
of  the  1990s  and  beyond.  Its  exterior  ap¬ 
pearance  resembles  the  P-3  maritime  pa¬ 
trol  aircraft,  but  the  airframe  will  use  new 
alloys  and  composites  to  provide  corrosion 
resistance.  More  fuel-efficient  turboprop 
engines  will  be  used.  It  will  utilize  fly-by¬ 
wire  control  and  engine  control-by-wire 
and  it  will  have  higher  capacity  environ¬ 
mental  control  and  electrical  power  capa¬ 
bility.  In  terms  of  payload,  the  LRAACA 
will  have  the  capability  to  carry  more  tor¬ 
pedoes,  more  air-to-surface  missiles,  and 
more  sonobuoys.  The  combat  iradius  will 
be  increased  while  maintaining  on-station 
capability.  The  avionics  suite  for  process¬ 


ing  acoustic,  radar,  and  ESM  sensor  data 
will  be  the  Update  JV,  which  is  already  in 
full-scale  development  (FSD)  for  the  P-3C 
aircraft. 

BACKGROUND 

A  draft  request  for  proposal  (RFP)  was  re¬ 
leased  in  early  1987  for  a  follow-on  to  the 
P-3C.  This  aircraft  was  designated  the 
P-3G.  It  was  determined  that  there  was 
insufficient  interest  within  industry  for 
competitive  procurement  of  a  P-3  deriva¬ 
tive.  In  May  1987^the  Navy  conducted  a 
LRAACA  mission  requirements  determi¬ 
nation  study.  A  draft  RFP  was  released 
and  industry  comments  were  solicited  on 
the  operational  potential  of  a  commercial 
derivative  aircraft  to  perform  the 
LRAACA  mission.  Industry  proposals 
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were  received  in  early  1988  and  source  se¬ 
lection  was  completed  in  October  1988 
when  the  P-3C  contractor  was  announced 
as  winner  of  the  LRAACA  competition. 
This  competition  was  for  the  airframe. 
The  intended  avionics  suite  is  in  FSD  with 
a  different  contractor  who  will  receive  the 
LRAACA  airframes  as  government  fur¬ 
nished  equipment  (GEE)  and  will  have  in¬ 
stallation  and  system  integration  responsi¬ 
bility. 

OT&E  ISSUES 

One  of  our  initiatives  has  been  to  conduct 
operational  assessments  earlier  in  the  ac¬ 
quisition  cycle,  while  there  is  still  suffi¬ 
cient  program  flexibility  to  correct  pro¬ 
jected  deficiencies  identified  in  the 
assessment.  COMOPTEVFOR,  the  Navy’s 
operational  test  agency,  conducted  an 
Elarly  Operational  Assessment  (EOA)  for 
this  program.  EOA  objectives  were  to  as¬ 
sess  the  operational  concept  of  LRAACA 
and  to  project  both  the  potential  opera¬ 
tional  effectiveness  and  potential  opera¬ 
tional  suitability. 

OT&E  ACTIVITY 

A  team  of  Navy  personnel  with  P-3C  op¬ 
erational  experience  conducted  the  EOA 
through  FY88.  Since  there  were  no  test 
results  to  examine,  the  team  used 
LRAACA  program  documentation  such  as 
the  RFP,  the  Operational  Requirement,  the 
Decision  Coordinating  Paper,  and  the  Up 
date  IV  avionics  specifications.  Because 
this  was  an  examination  of  program  docu¬ 
mentation  by  a  group  of  experts  in  the 
area  of  maritime  patrol  aircraft  operations 
and  requirements,  the  EOA  projections 


are  qualitative  in  nature  and  represent  ex¬ 
pert  opinion  instead  of  hard  facts. 

OT&E  ASSESSMENT 

With  regard  to  assessment  of  the  opera¬ 
tional  concept  and  projection  of  potential 
operational  effectiveness,  the  EOA  consid¬ 
ered  the  areas  of  mission  profiles;  ASW 
detection,  classification,  localization, 
tracking,  attack;  surface  threat  targeting 
and  attack;  combined  arms;  mining  capa¬ 
bility;  search  and  rescue;  communications; 
and  deployed  operations.  With  the  qualifi¬ 
cation  that  these  are  expert  opinions,  po¬ 
tential  operational  effectiveness  in  each  of 
these  areas  was  projected  as  satisfactory. 
Areas  considered  in  projection  of  potential 
operational  suitability  included  reliability; 
maintainability;  availability;  logistic  sup- 
portability;  compatibility;  interoperability; 
training;  human  factors;  safety;  documen¬ 
tation;  reaction  time;  and  growth  potential. 
Compatibility,  interoperability,  human  fac¬ 
tors,  reaction  time,  and  growth  potential 
were  projected  as  potentially  satisfactory. 
The  other  areas  were  unresolved  due  to 
limitations  of  scope  stemming  from  the 
degree  of  program  maturity  and  unavail¬ 
ability  of  documentation  at  this  early 
stage. 

DOT&E  considers  ihis  EOA  to  have 
been  highly  beneficial  to  the  LRAACA 
program  and  an  excellent  example  for  fu¬ 
ture  programs.  The  LRAACA  EOA  iden¬ 
tified  areas  requiring  attention  befcie  the 
program  entered  FSD.  Other  benefits  of 
this  EOA  were  identification  of  documen¬ 
tation  shortfalls  and  early  identification  of 
the  need  for  more  realistic  T&E  resources. 
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MK  48  ADVANCED  CAPABILITY  (ADCAP)  TORPEDO 


SYSTEM  DESCRIPTION 


minimum  effective  launch  ranges  than  the 
Mk  48  torpedo  it  will  replace. 


The  Mk  48  advanced  capability  (ADCAP) 
torpedo  is  a  submarine-launched  antisub¬ 
marine  warfare  (ASW)  and  antisurface 
warfare  (ASUW)  wire-guided  and  acous¬ 
tic  (both  active  and  passive)  homing  tor¬ 
pedo.  It  is  an  upgrade  to  the  existing  Mk 
48  heavyweight  torpedo.  It  replaces  the 
guidance  and  control  system  with  an  all- 
digital,  computer-based  system;  upgrades 
propulsion  for  increased  speed  and  depth; 
andf  improves  the  warhead  sensor  for 
ASUW.  The  Mk  48  ADCAP  should  pro¬ 
vide  significantly  improved  tactical  flexi¬ 
bility  through  greater  endurance;  shorter 
preset,  warm-up  and  reactivation  times; 
improved  salvo  operation;  and  shorter 


BACKGROUND 

The  Mk  48  was  developed  to  maintain 
weapon  effectiveness  against  surface  ships 
and  counter  advances  in  threat  submarine 
capabilities.  The  program  entered  the 
demonstration  and  validation  phase  in 
FY79  and  full-scale  development  in  FY82. 
In  FY84,  early  operational  test  and  evalu¬ 
ation  (OT-I)  was  conducted  concurrently 
with  development  testing  on  an  advanced 
development  model  torpedo.  The  OT&E 
supported  initial  procurement  of  long-lead 
materials,  tooling,  and  test  equipment. 
Results  of  an  operational  assessment  in 
FY85  supported  funding  for  fabrication  of 
the  initial  pilot  production  torpedoes. 
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Both  the  FY84  and  FY85  operational  test/ 
assessment  reports  made  recommenda¬ 
tions  to  enhance  weapon  performance.  In 
January  1985,  the  DOT&E  designated  the 
Mk-48  ADCAP  as  a  DOT&E  oversight 
program. 

In  FY87  a  second  phase  of  operational 
test  and  evaluation  (OT-EA)  was  con¬ 
ducted  to  support  a  decision  to  commence 
low-rate  initial  production  (LRIP).  The  fi¬ 
nal  phase  of  initial  operational  test  and 
evaluation  (OT-HB)  was  conducted  from 
December  1987  through  May  1988.  Both 
the  OT-EA  and  OT-EB  test  plans  were 
approved  by  DOT&E.  A  surface  target 
sinking  exercise  (SINKEX)  was  also  con¬ 
ducted  off  the  Virginia  Capes  in  July 
1988 

OT&E  ISSUES 

Operational  testing  during  FY88  examined 
the  operational  effectiveness  and  suitabil¬ 
ity  of  the  Mk  48  ADCAP  in  attacking  sub¬ 
marines  and  surface  ships.  The  principal 
OT&E  issues  addressed  were  the  ability  of 


the  torpedo  to  attack  maneuvering  and 
non-maneuvering  targets  and  a  full  range 
of  operational  suitability  issues.  These  is¬ 
sues  are  detailed  in  the  DOT&E  approved 
Test  and  Evaluation  Master  Plan  (TEMP). 

OT&E  ASSESSMENT 

The  details  of  the  OT&E  assessment  are 
classified  and  are  provided  in  the  DOT&E 
Beyond-LRIP  Report  to  Congress  and  the 
Secretary  of  Defense  dated  December  8, 
1988. 

OT&E  SUMMARY 

It  is  our  view  that  the  Mk  48  ADCAP  has 
demonstrated  a  significant  improvement  in 
operational  effectiveness  over  the  in-serv¬ 
ice  Mk  48.  The  classified  details  of  its 
operational  effectiveness  are  contained  in 
the  DOT&E  Beyond-LRIP  Report  to  Con¬ 
gress  and  the  Secretary  of  Defense  (De¬ 
cember  8,  1988).  The  Mk  48  ADCAP 
weapon  system  is  potentially  operationally 
suitable  with  improvements  required  in 
two  areas. 
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MK  50  TORPEDO 


SYSTEM  DESCRIPTION 


The  Mk  50  Torpedo  is  being  developed  as 
the  next  generation  lightweight  antisubma¬ 
rine  warfare  (ASW)  torpedo  to  counter  the 
projected  submarine  threats  of  the  late 
1980s  to  the  year  2000.  It  will  replace  the 
Mk  46  Mod  5  as  the  U.S.  Navy’s  primary 
conventional  ASW  weapon  for  aircraft  and 
surface  ships.  An  exercise  version  is  be¬ 
ing  developed  in  which  the  warhead  is  re¬ 
placed  with  a  data  recorder  and  buoyant 
recovery  system  to  provide  for  exercise 
in-water  runs.  The  Mk  50  system  includes 
the  torpedo,  ancillary  support  equipment, 


workshop  test  and  handling  equipment, 
and  logistics  support  facilities. 

The  Mk  50  Torpedo  warshot  and  exer¬ 
cise  versions  shall  be  capable  of  being  de¬ 
ployed  from  land-based  patrol  (VP)  air¬ 
craft  (P-3),  ASW  earner-based  (VS) 
aircraft  (S-3),  ASW  helicopters  (SH-2, 
SH-3,  SH-60),  ASW  surface  vessel  tor¬ 
pedo  tubes  (SVTT),  and  the  new  ASW 
Standoff  Weapon  (SEA  LANCE). 

BACKGROUND 

The  Mk  50  Program  started  with  a  techni¬ 
cal  assessment  phase  in  1975,  which  re- 
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viewed  various  designs  from  industry  of 
the  next  generation  lightweight  torpedo. 


Advanced  Development  commenced  in 
July  1979,  with  two  competitive  designs. 
Honeywell  and  McDonne  1  Douglas  were 
awarded  contracts  to  deve  op  and  test  pro¬ 
totype  models.  In  January  1981,  the  com¬ 
petition  was  terminated  due  to  cost  growth 
and  excessive  technical  risk  in  the  McDon¬ 
nell  Douglas  design.  The  program  was  re¬ 
structured  to  form  a  Navy-industry  team 
composed  of  Honeywell,  Garrett  (propul¬ 
sion  subcontractor),  the  Naval  Ocean  Sys¬ 
tems  Center,  and  the  Applied  Research 
Laboratory,  Pennsylvania  State  University. 
The  Demonstration  and  Validation  phase 
was  successfully  completed  in  July  1983. 


In  January  1984,  the  program  began 
the  Full  Scale  Development  (FSD)  phase. 
Early  FSD  testing  included  laboratory  and 
field  testing  of  various  components,  war¬ 
head  lethality  tests,  and  the  fabrication  of 
the  first  fleet  prototype.  Reductions  in  the 
FY86  budget  necessitated  a  replanning  of 
the  Mk  50  Engineering  Qualification  Trials 
(EQT)  to  reflect  a  reduction  in  RDT&E  ex¬ 
penditures. 


The  first  phase  (OT-IIA)  of  Initial  Op¬ 
erational  Test  and  Evaluation  (IOT&E) 
commenced  in  September  1986,  but  was 
terminated  by  the  program  office  due  to 
restructuring  of  the  FSD  program.  The 
previous  decision  to  reduce  RDT&E  tor¬ 
pedo  quantities  was  reversed,  and  the  FSD 
was  extended  with  adequate  numbers  of 
torpedoes  programmed  to  support  a  viable 
development  plan. 


OT&E  ISSUES 


The  primary  operational  effectiveness  is¬ 
sues  addressed  during  the  FY88  OT&E  in¬ 
cluded:  the  ability  of  the  torpedo  to  attack 
maneuvering  and  non-maneuvering  sub¬ 
marines;  the  ability  of  the  torpedo  to  oper¬ 


ate  in  shallow  water;  and  the  ability  of  the 
torpedo  to  operate  in  a  countermeasure 
environment.  The  suitability  issues  to  be 
addressed  included:  reliability,  compati¬ 
bility,  safety  and  logistic  supportability. 
Another  issue  was  the  suitability  of  mobile 
artificial  targets  for  use  in  future  OT&E. 
This  office  has  been  working  with  the 
Navy  to  clearly  define  and  improve  the 
test  resources  (targets  and  countermea¬ 
sures)  that  will  be  used  in  the  final  phase 
of  IOT&E  (OPEVAL). 


OT&E  ASSESSMENT 


OT-IIA  restarted  on  August  26,  1988,  and 
was  completed  on  November  26,  1988. 
The  test  plan  for  OT-IIA  was  approved  by 
DOT&E.  To  date,  the  data  from  18  of  the 
20  torpedo  launches  has  been  analyzed. 
Testing  was  conducted  at  the  Nanoose  Un¬ 
derwater  Tracking  Range  near  Nanaimo, 
British  Columbia,  Canada;  the  Quinault 
Underwater  Tracking  Range,  off  the  coast 
of  Washington;  and  the  Barking  Sands 
Tactical  Underwater  Range,  Kauai,  Ha¬ 
waii.  The  torpedoes  were  launched  from 
P-3,  S-3,  SH-2,  and  SH-3  aircraft.  The 
surface  platforms  used  to  launch  the  tor¬ 
pedoes  were  FF  1052  and  FFG  7  class 
ships  as  well  as  a  range  craft.  The  targets 
consisted  of  Mk  30  and  Mk  40  mobile  arti¬ 
ficial  targets  and  SSN  688  class  subma¬ 
rines. 


Although  the  analysis  of  the  final  two 
launches  is  not  complete,  it  is  evident  that 
they  will  not  affect  the  overall  conclusions 
of  this  OT&E.  The  Navy’s  independent 
operational  test  agent.  Commander,  Op¬ 
erational  Test  and  Evaluation  Force 
(COMOPTEVFOR),  concluded  that  the 
Mk  50  torpedo  has  the  potential  to  be  op¬ 
erationally  effective  and  the  potential  to  be 
operationally  suitable,  and  indicated  that 
the  testing  supported  a  recommendation 
for  limited  production.  COMOPTEVFOR 
recommended  the  correction  of  several 
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deficiencies  before  OPEVAL,  scheduled 
for  FY90. 

SUMMARY 

Within  the  constraints  of  the  test  limita¬ 
tions,  the  FY88  OT&E  of  the  Mk  50  tor¬ 
pedo  indicates  that  it  is  potentially  opera¬ 
tionally  effective  and  potentially 
operationally  suitable. 


MK  50  TORPEDO 
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SYSTEM  DESCRIPTION 

The  Pioneer  short-range  remotely  piloted 
vehicle  (SR-RPV)  is  a  cued  surveillance 
system.  Its  mission  is  to  provide  day  or 
night  real-time  reconnaissance,  battlefield 
surveillance,  target  acquisition,  artillery/ 
gun  suppon,  and  battle  damage  assess¬ 
ment  (BDA).  The  Pioneer  system  was 
originally  designed  to  operate  from  a  fixed 
base  using  a  runway  or  pneumatic 
launcher  for  takeoff  and  a  runway  for 
landing.  An  added  capability  to  operate 
from  selected  ships  was  developed. 

The  Pioneer  system  consists  of  five  to 
eight  air  vehicles  (AVs),  one  ground  con¬ 
trol  station  (GCS),  one  remote  tracking 
control  unit  (TCU),  one  portable  control 


PIONEER  REMOTELY 
PILOIED  VEHICLE 
(RPV) 


station  (PCS),  two  remote  receiving  sta¬ 
tions  (RRS),  launch  and  recovery  equip¬ 
ment,  and  ancillary  transport  and  mainte¬ 
nance  equipment.  The  shipboard-peculiar 
items  are  the  rocket  assisted  take-off 
(RATO)  launch  system  and  a  net  recovery 
system.  The  unmanned  AV  carries  a  mis¬ 
sion  payload  and  is  operated  by  direct 
control  or  through  a  preprogrammed  mis¬ 
sion  mode.  Direct  control  of  the  mission 
payload/AV  is  by  an  operator  in  the  GCS 
or  via  the  PCS  through  a  combination  of 
UHF  radio  and  C-Band  data  link  trans¬ 
missions.  The  mission  payloads  which  the 
AV  can  carry  are  the  MKD-200  daylight 
electro-optic  (EO)  low-light-level  TV 
camera  or  the  MKD-400  infrared  (1R) 
night  capable  camera.  A  VHF/FM  radio 


IV-71 


PIONEER  REMOTELY  PILOTED  VEHICLE  (RPV) 


NAVY 


relay  mission  payload  is  under  develop¬ 
ment. 


BACKGROUND 

In  a  July  8,  1985,  decision  memo,  the  Sec¬ 
retary  of  the  Navy  directed  the  procure¬ 
ment  of  unmanned  aerial  vehicle  (UAV) 
systems  as  soon  as  possible,  using  proven 
RPV  systems  in  order  to  provide  a  mini¬ 
mum  essential  operational  capability.  This 
procurement  was  intended  to  correct 
shortfalls  in  reconnaissance  capabilities 
experienced  during  the  Granada,  Leba¬ 
non,  and  Libyan  operations.  In  April 
1986,  the  Secretary  of  the  Navy  initiated 
the  RPV  “Quick  Go”  program.  Its  pur¬ 
pose  was  to  accelerate  the  use  of  RPV  sys¬ 
tems  aboard  amphibious  and  surface  com¬ 
batants  other  than  aircraft  carriers.  The 
overall  plan  for  “Quick  Go”  involved  Navy 
and  Marine  Corps  units.  The  Pioneer  sys¬ 
tem  was  first  installed  aboard  USS  Iowa 
(BB-61)  in  August  1986.  Initial  Pioneer 
operations  from  the  Iowa  were  success¬ 
fully  accomplished  in  December  1986. 
During  a  proof  of  concept  mini-cruise 
aboard  Iowa  in  January-February  1987, 

Siroblems  were  experienced.  The  lessons 
earned  were  incorporated  into  an  inte¬ 
grated  action  plan  to  correct  these  and 
previously  identified  deficiencies.  Opera¬ 
tional  assessment  and  tactical  employment 
of  the  Pioneer  with  Navy  ana  Marine 
Corps  units  continues. 


OT&E  ISSUES 


The  critical  operational  issues  that  have 
been  identified  in  draft  documents  are 
mission  performance,  targeting,  naval  gun 
fire  spotting  (NGFS),  Marine  Corps  artil¬ 
lery  adjustment,  survivability,  reliability, 
maintainability,  availability,  logistic  sup- 
portability,  compatibility,  training,  safety, 
human  factors,  and  documentation.  The 
Pioneer  SR-RFV  does  not  have  an  OSD- 


approved  Test  and  Evaluation  Master  Plan 
(TEMP). 

OT&E  ACTIVITY 

To  date,  dedicated  operational  testing  of 
the  Pioneer  has  not  been  conducted.  How¬ 
ever,  the  Navy  and  Marine  Corps  have  de¬ 
ployed  the  Pioneer  operationally.  In 
FY88,  both  Services  conducted  separate 
operational  assessments  of  the  Pioneer. 

The  Navy  operational  assessment  was 
conducted  on  the  shipboard  version  of  the 
Pioneer  system  onboard  the  Iowa  from 
September  29  to  October  6,  1987,  in  the 
Mediterranean  during  the  NATO  exercise 
Display  Determination.  Participation  of 
the  Pioneer  was  very  limited.  Four  day 
and/or  night  operational  flights  were  flown 
employing  either  the  TV  or  DR  cameras  in 
the  reconnaissance,  surface,  and  subsur¬ 
face  control  (SSC),  NGFS,  and  BDA  mis¬ 
sion  areas.  Because  of  the  limited  nature 
of  this  evaluation,  only  observations  and 
recommendations  were  made  by  the  Na¬ 
vy’s  operational  test  agency,  OPTEVFOR. 

The  Marine  Corps  operational  assess¬ 
ment  was  conducted  at  Marine  Corps 
Base,  Camp  Lejeune,  North  Carolina, 
from  September  28  to  October  9,  1987, 
during  the  Second  Marine  Division’s  com¬ 
mand  post  exercise  Excellent  Sword  and 
an  artillery  firing  exercise.  Surveillance 
and  reconnaissance  missions  were  flown 
using  either  the  TV  camera  or  IR  camera 
payloads.  Assessments  were  made  of  the 
capability  of  the  Pioneer  system  to  per¬ 
form  the  reconnaissance,  battlefield  sur¬ 
veillance/target  acquisition,  gunfire  spot¬ 
ting/adjusting,  and  BDA  missions. 
Operations  involved  14  flights,  five  of 
which  were  launched  at  night.  AH  flights 
were  recovered  during  daylight  due  to 
poor  AV  external  lighting.  A  member  of 
the  DOT&E  staff  observed  the  operational 
employment  of  the  Pioneer  system  by  the 
2nd  RPV  Company  during  this  exercise 
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and  flew  the  AV  and  controlled  the  pay- 
load  during  part  of  one  mission. 

The  following  assessments  were  made 
by  the  Marine  Corps  Operational  Test  and 
Evaluation  Activity  (MCOTEA): 

o  The  Pioneer  system  can  iocate 
and  identify  a  target  when  cued  to  the  gen¬ 
eral  target  location  if  the  target  is  not 
heavily  camouflaged  or  obscured. 

o  The  Pioneer  system  did  not 
demonstrate  the  ability  to  spot  and  adjust 
gunfire.  The  system  was  marginally  effec¬ 
tive  in  providing  BDA. 

o  The  AV  can  be  detected  visually 
and  aurally  when  flown  at  its  normal  oper¬ 
ating  altitudes. 

o  The  technical  maintenance  pub¬ 
lications  are  not  comprehensive  and  were 
difficult  to  understand.  The  Pioneer  sys¬ 
tem  integrated  logistics  support  plan  is  not 
fully  mature. 

o  The  Pioneer  system  training 
package  is  insufficient. 


o  The  Pioneer  system  demon¬ 
strated  mobility/transportability  but  with 
some  deficiencies. 

o  There  were  various  human  fac¬ 
tors  design  weaknesses  found.  The  most 
significant  was  the  fact  that  the  S-250 
shelter  is  not  large  enough  to  house  the 
GCS  components  and  crew  adequately. 

o  There  are  several  serious  safety 
related  conditions  associated  with  the  Pio¬ 
neer  system. 

Recommendations  were  made  by 
MCOTEA  to  modify  the  Pioneer  system 
significantly  to  reduce  or  eliminate  safety 
hazards,  improve  mission  payload  pre¬ 
flight  checks,  eliminate  the  AV  aural  sig¬ 
nature,  allow  for  night  recovery  opera¬ 
tions,  imDrove  the  GCS,  and  permit  AV 
flight  in  certain  rain  conditions. 

Operational  testing  of  the  Pioneer  by 
both  the  Navy  and  Marine  Corps  is  cur¬ 
rently  planned  to  begin  in  April  1989. 
This  schedule  is  in  part  dependent  upon 
receipt  and  approval  of  a  TEMP  and  an 
Operational  Test  Plan  by  DOT&E. 
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SYSTEM  DESCRIPTION  surveyed  location  and  are  not  considered 

relocatable. 

The  relocatable  over-the-horizon  radar 

(ROTH-R)  provides  long-range  detection,  OT&E  ASSESSMENT 
tracking,  and  correlation  of  airborne  tar¬ 
gets.  The  system  consists  of  separate  Operationa;  tests  are  scheduled  for  1989. 
transmit  and  receive  antennas  and  a  con-  Islo  operational  assessment  has  been  made 

trol  system.  The  control  system  is  but  developmental  tests  indicate  potential 

relocatable,  but  the  antennas  require  a  effectiveness. 


RELOCATABLE  OVER-THE- 
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SYSTEM  DESCRIPTION 


The  S-3A  WSIP  is  designed  to  upgrade 
the  carrier-based  S-3  weapon  system  to 
better  perform  the  sea  control  mission 
against  more  capable  threats.  The  new 
system,  designated  S-3B,  includes  a  new 
acoustic  processor,  a  99-channel 
sonobouy  receiver,  and  a  new  acoustic 
tape  recorder  for  improved  anti-subma¬ 
rine  warfare  (ASW)  capability  in  the  outer 
ASW  zone.  The  radar  system  was 
redesigned  to  provide  an  inverse  synthetic 
aperature  radar  (ISAR)  capability  which 
allows  the  classification  of  surface  ships. 
The  electronic  support  measures  (ESM) 
system  was  modified  to  increase  its  ability 
to  detect  and  classify  threat  emitters. 
These  improvements  provide  a  more  capa¬ 


ble  surface,  subsurface,  and  surveillance 
coordination  (SSSC)  capability  which, 
when  combined  with  the  HARPOON  mis¬ 
sile  added  as  part  of  the  WSIP,  provides 
the  S-3B  with  stand-off  surface  attack  ca¬ 
pability.  The  S-3B  was  also  provided  with 
a  defensive  capability  through  the  addition 
of  electronic  countermeasures  (ECM)  dis¬ 
pensers  for  chaff,  flares,  and  jammers. 
The  future  command  and  control  capabil¬ 
ity  of  the  S-3B  will  be  further  enhanced 
through  the  WSIP  space  and  weight  reser¬ 
vation  for  the  glottal  positioning  system 
(GPS)  and  joint  tactical  information  distri¬ 
bution  system  (JTIDS). 

BACKGROUND 

Initial  operational  test  and  evaluation 
(IOT&E)  of  the  S-3B  was  conducted  in 
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two  phases.  During  FY85,  the  S-3B  un¬ 
derwent  its  first  phase  of  operational  test¬ 
ing  (OT-IIA)  to  assess  potential  opera¬ 
tional  effectiveness  and  suitability.  The 
Navy’s  independent  operational  test  agent, 
Commander,  Operational  Test  and  Evalu¬ 
ation  (CQMOPTEVFOR),  determined  that 
this  testing  demonstrated  that  the  S-3B 
had  the  potential  to  be  operationally  effec¬ 
tive.  With  the  exception  of  software,  the 
S-3B  was  also  determined  to  have  the  po- 
tential  to  be  operationally  suitable.  COM- 
OFTEVFOR’S  findings  supported  a  rec¬ 
ommendation  for  limited  production. 

In  FY86,  the  second  phase  of  IOT&E 
(OT-ID3  -  OPEVAL)  commenced  using 
two  full-scale  engineering  development 
(FSED)  aircraft.  The  OPEVAL  test  plan 
was  approved  by  DOT&E.  The  perform¬ 
ance  of  several  subsystems  (radar,  ECM, 
and  HARPOON)  was  excellent.  However, 
deficiencies  in  the  system  software  and  the 
maintainability  of  the  aircraft  rendered  the 
S-3B  system  not  sufficiently  operationally 
suitable  to  support  OPEVAL,  and  COM- 
OFTEVFOR  placed  the  S-3B  in  deficiency 
status  in  September  1986.  As  a  result  of 
the  delay  in  OPEVAL  and  discussions  with 
DOT&E,  the  Navy  decided  to  restructure 
its  procurement  plan  for  the  S-3B.  It  re¬ 
mained  in  low-rate  initial  production 
5-RIP)  pending  satisfactory  completion  of 
OPEVAL.  Initially  the  Navy  had  intended 
to  commence  full  production  in  FY87. 
Following  extensive  modifications  to  the 
system  software  and  maintainability  im¬ 
provements,  the  OPEVAL  was  restarted  in 


December  1987  and  subsequently  com¬ 
pleted  in  March  1988. 

OT&E  ISSUES 

Principal  operational  effectiveness  issues 
addressed  during  the  OPEVAL  included: 
submarine  detection,  classification,  local¬ 
ization  and  attack;  HARPOON  targeting 
and  attack;  and  electronic  support  meas¬ 
ures  (ESM)  capabilities  The  operational 
suitability  issues  addressed  included:  reli¬ 
ability,  maintainability,  interoperability, 
training,  documentation  and  human  fac¬ 
tors. 

OT&E  ASSESSMENT 

The  details  of  our  OT&E  assessment  are 
classified  and  were  provided  in  the 
DOT&E  Beyond-LRIP  Report  to  Congress 
and  the  Secretary  of  Defense  (June  13, 
1988). 

SUMMARY 

The  summary  of  the  OT&E  assessment  is 
classified  and  was  provided  to  Congress 
and  the  Secretary  of  Defense  in  the 
DOT&E  Beyond-LRIP  Report  dated  June 
13,  1988.  A  continuing  program  of  fol- 
low-on  operational  testing  is  required  to 
verify  correction  of  various  deficiencies  in 
effectiveness  and  suitability,  and  to  re¬ 
solve  limitations  to  the  scope  of  testing  to 
date.  However,  the  decision  to  proceed 
beyond  low-rate  initial  production  of  the 
S-3B  is  considered  low  risk. 
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SYSTEM  DESCRIPTION 


The  SM-2  Block  II  is  a  solid-propellant- 
fueled,  tail-controlled,  surface-to-air  and 
surface-to-surface  missile.  It  was  de¬ 
signed  to  counter  high-speed,  high-alti¬ 
tude  antiship  missiles  in  an  advanced  elec¬ 
tronic  countermeasures  (ECM)  environ¬ 
ment.  There  are  four  versions  of  this  mis¬ 
sile:  three  medium-range  (MR)  rounds 
(for  the  Aegis  Mk  26  rail-launch  system, 
the  Aegis  vertical  launching  system,  and 
the  Tartar  rail-launch  system)  and  one  ex¬ 
tended-range  (ER)  round  (for  the  Terrier 
rail-launch  system).  SM-2  has  the  capa¬ 
bility  to  engage  targets  through  utilization 
of  mid-course  guidance  with  illumination 
of  the  target  by  the  ship  for  missile  hom¬ 
ing  during  the  terminal  phase,  or  home- 


all-the-way  guidance  wherein  the  target  is 
illuminated  throughout  the  period  of  mis¬ 
sile  flight  and  the  missile  guides  toward 
intercept,  utilizing  the  reflected  radar  sig¬ 
nal  from  the  target  (SM-1  guides  only  m 
home-all-the-way  mode).  Block  n  im¬ 
provements  include  a  new  signal  processor 
to  provide  less  vulnerability  to  ECM,  an 
improved  fuze  and  focused-blast  fragment 
warhead  to  provide  better  kill  probability 
against  smaller,  harder  targets,  and  new 
propulsion  for  higher  velocities  and  ma¬ 
neuverability.  Component  commonality  is 
maximized  among  the  various  SM-2 
Block  II  versions. 

BACKGROUND 

The  SM-2  Block  II  began  development  in 
1976  and  began  production  in  1982  (ER) 
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and  1983  (MR).  Follow-on  OT&E 
(FOT&E)  was  successfully  conducted  on 
the  SM-2  Block  H  (ER)  in  FY85  and  was 
followed  by  submission  of  the  DOT&E’s 
Beyond  Low-Rate  Initial  Production  Re¬ 
port  to  the  Secretary  of  Defense  and  Con¬ 
gress.  FOT&E  of  the  MR  version  was  con¬ 
ducted  in  FY86  with  an  Aegis  cruiser, 
USS  Vincennes,  equipped  with  the  Mk  26 
rail  launcher.  These  firings  provided  the 
basis  for  the  FY87  procurement.  The 
overall  results  of  this  FOT&E  supported  a 
recommendation  by  the  Navy’s  Opera¬ 
tional  Test  Agency  to  continue  limited 
fleet  introduction  of  the  weapon.  Full  pro¬ 
duction  approval  for  SM-2  Block  II  was 
granted  in  December  1986. 

OT&E  ISSUES 

The  major  OT&E  issues  addressed  during 
the  FY88  testing  included  determination  of 
missile  effectiveness  against  various  air 
targets.  Other  issues  included  determina¬ 
tion  of  missile  effectiveness  when  sup¬ 
ported  by  the  particular  weapon/combat 
system  involved  (Terrier  New  Threat  Up¬ 
grade  (NTU)  and  Baseline  2  Aegis 
Weapon  System),  as  well  as  assessment  of 
missile  survivability  in  an  operational  en¬ 
vironment. 

OT&E  ACTIVITY 

FY88  FOT&E  consisted  of  testing  both  the 
ER  version  from  a  Terrier  NTU  ship  and 
the  MR  Aegis  version  from  an  Aegis  ship 
with  vertical  launch  capability.  A  DOT&E 
staff  member  observed  testing  from  the 
missile  firing  ship  during  the  ER  testing 
and  during  the  MR  testing.  ER  testing  was 
conducted  with  USS  Biddle  with  a  produc¬ 
tion  NTU  Combat  System,  which  is  de¬ 
signed  to  counter  the  Soviet  AS-4  and 
AS-6  antiship  cruise  missiles  in  an  ECM 
environment.  Eight  SM-2  Block  n  ER 
missiles  were  fired  in  the  Atlantic  Fleet 
Weapons  Training  Facility  Puerto  Rican 
operating  area  during  April  and  May 
1988.  MR  testing  was  conducted  with 


USS  Antietam  during  April  1988.  Twelve 
SM-2  Block  Q  MR  missiles  were  fired  at 
the  Pacific  Missile  Test  Center  range  off 
the  coast  of  southern  California. 

OT&E  ASSESSMENT 

SM-2  ER.  Testing  of  the  SM-2  Block  n 
ER  missile  with  the  Terrier  NTU  system  in 
the  Puerto  Rican  operating  area  resulted  in 
the  presentation  of  15  targets.  Although 
security  and  safety  considerations  resulted 
in  the  briefing  of  the  ship’s  commanding 
officer  on  threat  sectors,  target  presenta¬ 
tion  times,  and  target  geometries,  he  did 
not  share  that  information  with  his  crew. 

SM-2  MR.  Testing  of  the  SM-2 
Block  II  MR  missile  with  the  vertical 
launch-capable  Aegis  cruiser  in  the  south¬ 
ern  California  operating  area  resulted  in 
presentation  of  12  targets.  As  in  the  case 
of  the  ER  testing,  the  commanding  officer 
was  briefed  on  the  intended  scenarios,  but 
did  not  share  this  information  with  his 
crew  except  for  an  instance  where  a  target 
cruise  missile  was  engaged.  That  scenario 
placed  Antietam  at  a  position  offset  about 
five  miles  from  the  target  missile  flight 
path.  Since  there  was  a  potential  that  the 
missile  could  lock  onto  Antietam  instead  of 
its  intended  target  boat,  the  commanding 
officer  requested  and  was  granted  permis¬ 
sion  to  share  the  scenario  information  with 
selected  officers  in  his  crew.  In  the  judg¬ 
ment  of  DOT&E,  this  selected  sharing  of 
information  which  could  affect  ship/crew 
safety  did  not  compromise  the  integrity  of 
the  operational  testing  nor  did  it  bias  re¬ 
sults. 

In  conjunction  with  testing  from  An¬ 
tietam,  the  throughput  at  the  supporting 
Naval  Weapons  Station  was  examined  in 
order  to  evaluate  the  success  rate  for  mis¬ 
sile  tests  conducted  during  missile 
assembly. 

Both  phases  of  testing  (ER  in  the 
Puerto  Rican  operating  area  and  MR  in  the 
southern  California  operating  area)  shared 
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similar  limitations  to  testing.  These  in¬ 
cluded  the  use  of  various  targets  which  ap¬ 
proximate  air  threat  characteristics  to  dif¬ 
ferent  degrees.  Areas  in  which  there  are 
disparities  between  the  actual  threat  and 
the  targets  include  the  approach  speeds 
and  altitudes,  physical  dimensions,  and  ra¬ 
dar  reflective  characteristics.  Other  limi¬ 
tations  to  testing  included  those  associated 
with  safety  and  conduct  of  testing  on  in¬ 
strumented  test  ranges.  For  example,  as 
noted  under  preceding  discussions,  the 
commanding  officers  of  both  ships  were 
briefed  on  the  intended  scenarios  prior  to 
the  tests,  but  they  did  not  share  the  infor¬ 
mation  with  their  crews  (except  for  the 
case  of  the  target  missile  fired  on  by  An- 
tietam ).  Any  other  alertment  of  crew 
members,  such  as  preparation  of  missiles, 
would  have  been  no  different  than  that  ex¬ 
perienced  in  a  combat  situation.  The 
physical  size  of  the  test  ranges  generally 
results  in  the  presentation  of  air  targets  in 
such  a  manner  that  missiles  fired  at  them 


are  toward  the  open  ocean,  thereby  pro¬ 
viding  general  knowledge  to  a  ship’s  crew 
of  the  direction  from  which  the  simulated 
threats  will  approach.  Moving  the  ships 
farther  from  land  renders  useless  much  of 
the  insti  jmentation  required  for  recon¬ 
struction  of  the  operational  testing,  intro¬ 
duces  more  problems  of  communication, 
and  reduces  the  available  flight  time  of 
many  of  the  air  targets.  Moreover,  during 
the  period  preceding  actual  combat,  crews 
usually  know  the  general  axis  direction 
along  which  enemy  air  targets  will  ap¬ 
proach. 

SUMMARY 


Based  on  results  achieved,  SM-2  Block  n 
is  considered  operationally  effective 
against  most  targets,  taking  into  considera¬ 
tion  the  constraints  imposed  by  test  limita¬ 
tions.  The  SM-2  Block  II  (Aegis)  missile, 
supported  by  the  Base  ine  2  Aegis  weapon 
system,  is  considered  potentially  opera¬ 
tionally  suitable. 


STANDARD  MISSILE-2 
BLOCK  II  (SM-2) 


IV-81 


T-45  TRAINING  SYSTEM 


a 


* 


m 


SYSTEM  DESCRIPTION 

The  T-45  training  system  (T-45TS)  is  an 
integrated  training  system  composed  of 
five  main  subsystems:  the  aircraft,  simula¬ 
tors,  an  academics  package,  the  training 
integration  system  (TIS),  and  contractor 
logistics  support.  The  T-45TS  is  intended 
to  provide  the  Navy  with  modernized  fixed 
wing  intermediate  and  advanced  under¬ 
graduate  jet  flight  training,  replacing  the 
T-2B/C  and  TA-4J  and  their  associated 
training  systems. 

The  T-45A  Goshawk  is  a  tandem-seat, 
light-weight,  carrier-capable,  high- 
performance  aircraft,  powered  by  a  single 
Rolls  Royce  F405-RR-400  turbofan 


engine.  It  incorporates  an  on-board  oxy¬ 
gen  generating  system,  a  head  up  display 
(HUD),  and  a  weapons  delivery  capability 
for  training.  The  T-45A  is  a  derivative  of 
the  existing  British  Aerospace  (BAe) 
Hawk. 


The  simulator  subsystem  includes  the 
2F137  instrument  flight  trainer  (IFT)  and 
2F138  operational  flight  trainer  (OFT). 
The  IFT  is  essentially  an  OFT  without  the 
visual  cueing  system.  The  OFT  is  a 
ground-based  flight  simulator  equipped 
with  a  wide-angle  visual  system,  a  buffet- 
vibre'ion  motion  cueing  system,  a  dynamic 
G-seat,  an  active  anti-G  suit,  lap  belt,  and 
restraining  harness.  TT  e  simulators  utilize 
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existing  technology  developed  for  the 
F/A-18  simulator. 

The  academics  subsystem  is  intended 
to  provide  a  totally  integrated  multi-media 
based  system  capable  of  providing  a  bal¬ 
ance  of  classroom  and  other  instruction 
for  both  students  and  instructors  under 
training  (IUT).  It  includes  a  combination 
of  classroom  lectures,  textbooks,  work¬ 
books,  4E10  computer  assisted  instruction 
(CAI)  training  devices  and  other  media, 
which  will  be  closely  integrated  with  the 
simulator  and  flight  training  phases. 

The  TIS  consists  of  computer  hardware 
(4E9),  software,  communications  and  pe¬ 
ripheral  equipment.  The  purpose  is  to  fa¬ 
cilitate  efficient  scheduling  and  use  of  all 
training  resources,  (including  instructors 
and  student),  maintenance  of  student  and 
instructor  records,  and  management  of  the 
curriculum  and  student  flow. 

Contractor  logistics  support  will  be 
provided  for  all  levels  of  maintenance  and 
logistics  for  the  T-45TS  subsystems.  The 
contractor  will  determine  the  integrated  lo¬ 
gistic  support  (XLS).  The  Navy  will  fund 
them  and  turn  them  over  to  the  contractor 
for  ELS  management. 

BACKGROUND 

The  T-45TS  was  authorized  for  full-scale 
development  in  October  1984.  Based  on 
reviews  of  the  T-45TS  program  by  the 
OSD  staff,  the  September  1987  Milestone 
DIA  review  was  changed  to  September 
1988.  fn  the  interim,  the  Navy  was 
authorized  to  release  the  FY88  funding  for 
the  procurement  of  12  pilot  production  lot 
aircraft,  1  OFT,  1  IFT,  1  TIS,  1  academic 
suite,  and  FY  88  long-lead  funding  for 
procurement  of  the  first  limited  produc¬ 
tion  lot  of  24  aircraft.  The  T-45A  first 
flew  in  April  1988.  During  developmental 
flight  testing,  a  longitudinal  control  system 
anomaly  was  encountered.  The  cause  has 
been  identified,  a  solution  has  been  pro¬ 


posed,  and  flight  testing  is  continuing. 
Also,  a  clean  wing  powered  approach 
“roll-off"  problem  was  experiencea.  This 
roll-off  has  been  reduced  by  adding  wing 
dressing  elements.  Wing  configuration  de¬ 
velopment  is  progressing  toward  identify¬ 
ing  a  configuration  with  satisfactory  stall 
characteristics.  These  development  prob¬ 
lems  delayed  the  start  of  T-45A  and  OFT 
initial  operational  testing.  The  Milestone 
DIA  decision  is  now  scheduled  for  early 
1989. 

OT&E  ISSUES 

The  purpose  of  OT-DA  was  to  assess  the 
potential  operational  effectiveness  and 
suitability  of  the  T-45A  aircraft.  The 
critical  operational  issues  for  partial  reso¬ 
lution  were  to  assess  (1)  the  potential  ef¬ 
fectiveness  of  the  T-45A  as  an  under¬ 
graduate  jet  trainer  (flight  training),  (2) 
cockpit  design  for  safety  and  instructor 
control,  (3)  reliability,  (4)  availability,  f5) 
logistic  supportability,  (6)  training,  (7) 
documentation,  (8)  human  factors,  and  (9; 
ground  and  airborne  safety. 

OT&E  ACTIVITY 

In  order  to  determine  the  T-45A’s  poten¬ 
tial  training  effectiveness  and  suitability, 
IOT&E  of  the  2F138  flight  simulator 
(OFT)  was  conducted  in  December  1988. 
A  member  of  the  DOT&E  staff  observed 
the  operational  test  and  “flew”  the  OFT. 
Three  members  of  the  DOT&E  staff  previ¬ 
ously  flew  the  developmental  version  of 
the  OFT.  These  simulator  flights  included 
exposure  to  all  six  mission  elements  for 
which  the  OFT  will  be  used.  Our  assess¬ 
ment  of  the  OFT  will  be  included  in  our 
next  Annual  Report. 

DOT&E  has  been  closely  involved  in 
the  designation  of  the  Navy  independent 
test  agency,  COMOPTEVFOR,  as  the  re¬ 
sponsible  agency  for  the  T-45TS 
OPEVAL.  We  have  also  emphasized  the 
issues  of  (1)  ensuring  that  adequate 
T-45TS  operational  test  information  is 


IV-84 


T-45  TRAINING  SYSTEM 


NAVY 


m 


available  for  the  Milestone  Q1A  decision, 
and  (2)  the  hybrid  digital  cockpit. 

OT&E  ASSESSMENT 

The  T-45A  underwent  early  IOT&E,  OT- 
DA,  from  November  17  to  November  21, 
1988.  This  was  the  first  phase  of  IOT&E 
for  the  aircraft.  OT-IIA  consisted  of  10 
flights  and  13.3  flight  hours.  The  limita¬ 
tions  to  test  included  (1)  a  limited  aircraft 
flight  envelope;  (2)  prohibition  of  flight 
into  visible  moisture  or  precipitation;  (3) 
the  NACES  seat,  standard  attitude  head¬ 
ing  reference  system,  head  up  display,  and 
production  lighting  were  not  installed;  (4) 
the  aircraft  was  427  pounds  heavier  than 
the  production  model  due  to  instrumenta¬ 
tion;  (5)  the  wing  dressing,  longitudinal 
control  system,  yaw  damper  and  arresting 
hook  were  not  in  their  final  configurations; 
and  (6)  maximum  rate  of  descent  for 
landing  was  restricted  to  15  feet  per  sec¬ 
ond. 

Findings  on  the  critical  operational  is¬ 
sues  were  as  follows:  Flight  training:  Ex¬ 
cessive  pitch  problems  were  encountered 
with  speedbrake  extension  and  retraction. 
Speedbrake  extension/retraction  caused  a 
pitch-up/pitch-down  requiring  approxi¬ 
mately  10  pounds  of  stick  pressure  and 
large  stick  movement  to  counter.  Load 
factor  changes  of  0.5-0.6G  were  observed. 
Waveoff  performance  during  field  carrier 
landing  practice  (FCLP)  was  unsatisfac¬ 
tory  when  attempted  from  power  settings 
below  that  for  a  nominal  approach.  Alti¬ 
tude  loss  was  excessive  when  correcting 
from  higher  than  optimal  sink  rates  or  de¬ 
celerating  approaches.  Bolter  ground  roll 
distances  of  more  than  800  feet  occurred 
with  less  than  optimal  power  settings  at 
touchdown.  Stall  cues  were  inadequate 
for  a  student  naval  aviator  to  recognize, 
roll-off  was  rapid,  large  and  unpredict¬ 
able,  and  stall  recovery  angle  of  attack 
(AOA)  was  difficult  to  establish.  Accel¬ 


eration  and  deceleration  performance  was 
poor  in  side-by-side  comparisons  with  the 
current  advanced  jet  trainer  aircraft,  the 
TA-4J.  The  T-45A  demonstrated  excel¬ 
lent  turn  performance  and  aerobatic  po¬ 
tential.  Cockpit  design:  The  forward  field 
of  view  from  both  cockpits  was  excellent. 
There  were  some  deficiencies  noted  re¬ 
garding  control  of  the  aircraft  from  the 
rear  cockpit  in  case  of  an  emergency.  Re¬ 
liability:  There  were  no  cancellations  or 
major  failures  during  the  test.  Availability: 
The  demonstrated  availability  was  1.0. 
Ijogistic  supportabiiity:  No  logistic  support 
deficiencies  were  noted.  Training:  No  de¬ 
ficiencies  were  noted.  Documentation:  No 
deficiencies  were  noted.  Human  factors: 
There  were  various  deficiencies  noted  in 
handle/switch  activation  and  instrument 
readability.  Ground  and  airborne  safety: 
There  were  some  significant  safety  con¬ 
cerns  and  issues  including  poor  wave-off 
and  bolter  performance,  inadequate  stall 
wanting,  excessive  roll-off  after  stall,  and 
pitch  changes  after  speedbrake  extension 
or  retraction. 

Based  on  these  test  results  and  within 
the  test  limitations,  COMOPTEVFOR  and 
DOT&E  assess  the  T-  45A  to  be  (1)  poten¬ 
tially  operationally  effective  as  a  flight 
trainer  in  the  non-aircraft  carrier  environ¬ 
ment,  (2)  not  operationally  effective  in  the 
carrier  environment  in  its  current  configu¬ 
ration,  and  (3)  not  operationally  suitable 
in  its  current  configuration  due  to  safety 
deficiencies. 

In  December  1988,  the  Director  re¬ 
ceived  a  briefing  from  the  T-45TS  pro¬ 
gram  manager  concerning  corrections  to 
the  deficiencies  identified  in  this  early  op¬ 
erational  test.  Fixes  to  the  most  signifi¬ 
cant  deficiencies  are  expected  to  undergo 
operational  testing  in  January/February 
1989,  and  the  results  will  be  available  be¬ 
fore  making  the  Milestone  D3A  production 
decision. 
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SYSTEM  DESCRIPTION 

The  tactical  air  operations  center/modular 
control  equipment  (TAOC/MCE)  program 
is  not  a  major  defense  acquisition  pro¬ 
gram,  but  was  designated  for  DOT&E 
oversight  in  accordance  with  10  USC  138. 
The  program  is  in  the  second  year  of  low- 
rate  initial  production  (LRIP).  Tactical  air 
operations  modules  (TAOMs)  and  opera¬ 
tions  modules  (OMs),  nomenclatured  AN/ 
TYQ-23(V),  are  the  primary  equipment 
developed  in  this  program.  These  mod¬ 
ules  are  used  as  automated  air  command 
and  control  system  building  blocks  in  vary¬ 
ing  combinations  to  replace  the  currently 
deployed  Marine  Corps  tactical  air  opera- 
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tions  central  (TAOC)  and  tactical  data 
communications  central  (TDCC),  collec¬ 
tively  known  as  the  Marine  Tactical  Data 
System  (MTDS),  and  the  Air  Force  control 
and  reporting  center  (CRC)/control  and  re¬ 
porting  post  (CRP)  and  forward  air  control 
post  (FACP)  systems  known  as  407L  and 
485L.  TAOC/MCE  systems  are  packaged 
in  8x8x20  foot  transportable  military  shel¬ 
ters  (TAOMs  or  OMs)  to  provide  ground- 
based  automated  air  surveillance  and  com¬ 
mand  and  control  capability.  Tailoring  of 
the  system  capacity  is  achieved  by  the  use 
of  one  or  more  of  the  modules.  Up  to  five 
modules  are  to  be  interconnected  with  fi¬ 
ber  optic  cables  at  lengths  to  allow  disper¬ 
sion  for  tactical  or  other  considerations. 
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All  mission  essential  equipments  are  inter¬ 
nal  to  the  module  except  the  separate  ra- 
dars,  identification  friend  or  foe  (IFF) 
equipment,  and  prime  power  sources. 
Shelter  design  is  to  allow  the  transport  of 
a  module  by  fixed  or  rotary  wing  aircraft, 
ship,  rail,  mobilizer,  or  truck.  On-an-off 
loading  is  to  be  accomplished  by  crane, 
container  transporter,  or  fork  lift.* 

BACKGROUND 

TAOC/MCE  is  a  multi-Service  program. 
Acquisition  is  being  conducted  by  the  Ma¬ 
rine  Corps  under  a  Navy  contract.  The 
Navy  initiated  development  in  1978,  and 
the  Air  Force  entered  the  program  in 
1982.  A  full-scale  development  system 
was  tested  from  June  1986  to  January 
1987.  Four  modules  were  tested  by  Ma¬ 
rine  Air  Control  Squadron  One  (MACS-1) 
at  Camp  Pendleton,  California,  and  one 
module  was  tested  at  Hurlburt  Field,  Eglin 
Air  Force  Base,  Florida.  A  single  module 
was  transported  by  C-141  from  Camp 
Pendleton  to  Hurlburt  Field  for  inter¬ 
operability  testing.  Results  of  initial  op¬ 
erational  test  and  evaluation  (IOT&E)  pro¬ 
vided  information  for  separate  Service 
LRDP  decisions  and  award  of  the  contract 
in  May  1987.  The  Services  plan  various 
future  improvements  to  the  system  to  add 
separately  developed  system  enhance¬ 
ments  and  such  other  mission  essential 
preplanned  product  improvements  (P3I)  as 
jam  resistant  communications. 

OT&E  ISSUES 

Different  issues  have  been  applied  by  the 
Marine  Corps  and  the  Air  Force.  Marine 
Corps  issues  included  the  capability  to  in¬ 
crease  system  mobility  and  modular  capa¬ 
bility;  reduce  mission  reaction  time  and  in¬ 
crease  system  capacity;  improve 
commonality  among  modules;  enhance 
“graceful  degradation;"  and  possess  the 
ability  to  exploit  the  capabilities  of  new 
sensors,  communications  systems,  and 
weapons  fully  during  the  system’s  lifetime. 


Air  Force  issues  included  the  capability  to 
function  as  elements  of  the  ground  tactical 
air  control  system  (TACS),  sustain  opera¬ 
tions  in  TACS  despite  reconfiguration  or 
losses  due  to  hostile  action,  be  deployed 
and  redeployed  in  the  tactical  environ¬ 
ment,  interoperate  with  other  command 
and  control  facilities  and  systems,  support 
mission  essential  P3I,  and  support  sus¬ 
tained  operations  within  the  maintenance 
concept.  Limited  assets  did  not  allow 
full-configuration  testing  by  the  Air  Force 
during  the  FY86-87  IOT&E  consequently, 
the  Air  Force  observed  and  used  Marine 
Corps  IOT&E  results  wherever  practical. 

Follow-on  operational  test  and  evalu¬ 
ation  (FOT&E)  is  required  to  demonstrate 
corrections  to  problems  noted  during 
IOT&E,  provide  information  for  the  full- 
rate  production  decision,  and  .  ensure  inte¬ 
grated  capability  of  the  fully  P3I-config- 
ured  system.  These  issues  have  yet  to  be 
coordinated  into  a  Test  and  Evaluation 
Master  Plan  (TEMP)  and  an  operational 
test  (OT)  plan  for  approval  by  OSD.  Ef¬ 
forts  by  OSD  to  obtain  a  Service-approved 
TEMP  have  been  unsuccessful  to  date. 

OT&E  ACTIVITY 

There  has  been  no  OSD-approved  OT&E 
of  TAOC/MCE  in  FY88.  Activities  have 
focused  on  the  Service  approval  of  a 
TEMP  to  resolve  IOT&E  deficiencies. 

IOT&E  of  TAOC/MCE  began  in  June 
1986  and  continued  through  January  1987. 
Marine  Corps  testing  was  conducted  in 
three  phases.  Phase  1  including  setup/ 
packup  of  OMs,  training  of  MCAS-1  aug- 
mentee  personnel,  and  system  checkout. 
Phase  2  consisting  of  eight  weeks  of  op¬ 
erational  scenarios,  including  data  link 
with  F-4  and  F-18  aircraft,  embarking 
and  operation  aboard  ship,  landing  across 
the  beach,  and  interface/interoperability 
with  existing  Navy  and  Marine  Corps  com¬ 
mand  and  operations  centers,  including 
participation  in  Exercise  Kernel  Blitz 
86-2.  Phase  3  entailed  dual  TAOM  opera- 

TACTICAL  AIR  OPERATIONS 
CENTER/MODULAR 
CONTROL  EQUIPMENT 
(TAOC/MCE) 


IV-88 


NAVY 


tion  establishing  a  two-site  capability  with 
data  link  and  remote  radar  operations. 
TAOMs  have  been  used  in  various  exer¬ 
cises  since  IOT&E. 

Air  Force  testing  was  conducted  in 
four  phases.  Phase  1  consisted  of  observ¬ 
ing  activities  at  MACS-1.  Phase  2  in¬ 
volved  single  OM  testing  at  Hurlburt  Field 
to  evaluate  the  concept  of  modular  re¬ 
placement  of  the  existing  FACP  and  CRC/ 
CRPs  with  automated  systems.  Phase  3 
was  testing  of  interoperability  between  a 
single  Air  Force  OM  and  a  Marine  Corps 
TAOM  which  was  transported  from  Camp 
Pendleton  to  Hurlburt  Field  after  comple¬ 
tion  of  testing  by  MACS-1.  Phase  4  in¬ 
cluded  conversion  of  the  Marine  Corps 
TAOM  to  an  Air  Force  OM  configuration 
followed  by  two-OM  testing. 

The  Marine  Corps  Operational  Test 
and  Evaluation  Activity  (MCOTEA)  par¬ 
ticipated  in  testing  of  the  TAOM  and  is¬ 
sued  an  independent  evaluation  report 
(IER)  in  December  1986.  The  Air  Force 
Operational  Test  and  Evaluation  Center 
(AFOTEC)  conducted  testing  of  the  MCE 
and  issued  two  reports,  a  preliminary  re¬ 
port  November  1986  and  a  final  report  in 
Apiil  1987.  IOT&E  was  observed  by 
DOT&E  representatives. 

OT&E  ASSESSMENT 

TAOM/MCE  is  assessed  by  DOT&E  as  op¬ 
erationally  effective  and  capable  of  carry¬ 
ing  out  its  mission.  It  is  estimated  that 
fielding  of  the  system  can  be  expected  to 
increase  operational  effectiveness  over  the 
systems  being  replaced.  A  limited  opera¬ 


tional  capability  can  be  established  with 
only  one  module.  Setup  and  initialization 
times  are  approximately  eight  times  faster 
than  those  of  current  systems.  Air  surveil¬ 
lance,  weapon  control,  and  air  traffic  con¬ 
trol  functions  along  with  the  operator  con¬ 
sole  capability  are  improvements  over 
current  systems.  Primary  constraints  that 
periodically  limit  operational  effectiveness 
are  limitations  in  the  TAOM  automatic 
handling  of  high  density  radar  target  in¬ 
puts  that  occurs  when  the  interconnected 
radars  are  operating  in  an  automatic  ac¬ 
quisition  mode,  periodic  critical  loss  of 
communications  capability  due  to  failures 
of  the  communications  interface  unit 
(CIU)  or  the  fiber  optic  interface  panel, 
delays  in  keying  for  voice  communica¬ 
tions,  soft  vare  maturity,  and  durability  of 
cables  and  connectors. 

The  system’s  operational  suitability  is 
marginal.  Improvements  are  required  in 
reliability,  technical  manuals  and  docu¬ 
mentation,  and  supportability  of  software 
and  firmware.  Transportability  was  not 
rated  by  the  Air  Force  due  to  the  lack  of  a 
production -representative  mobilizer  and 
the  approved  tractor-trailer  combination. 

A  thorough  FOT&E  is  required  to  dem¬ 
onstrate  the  correction  of  operational  ef¬ 
fectiveness  problems  noted  during  IOT&E, 
confirm  operational  suitability,  provide  in¬ 
formation  for  execution  of  individual  Serv¬ 
ice  option-year  awards  and  an  appropriate 
full-rate  production  decision,  and  ensure 
integrated  capability  of  the  fully  P31-con- 
figured  systems.  Service  approval  of  a 
TEMP  and  OT  Plan  for  submission  to 
OSD  is  seriously  delinquent. 


TACTICAL  AIR  OPERATIONS 
CENTER/MODULAR 
CONTROL  EQUIPMENT 
(TAOC/MCE) 


iv-89 


TOMAHAWK 


m 


SYSTEM  DESCRIPTION 

The  TOMAHAWK  System  is  a  long-range 
cruise  missile  system  designed  to  be 
launched  from  submarines  and  surface 
ships  against  land  targets  and  ships. 
There  are  four  missile  variants,  anti-snip 
(TASM),  nuclear  land  attack  (TLAM-N), 
conventional  land  attack  (TLAM-C),  and 
conventional  land  attack  submunition 
(TLAM-D).  Each  variant  is  contained 
within  a  pressurized  canister  to  form  an 
all-up-round.  The  submarine  all-up- 
round  is  launched  from  torpedo  tubes  or 
vertical  tubes  located  in  the  nonpressure 
hull  area.  The  surface  ship  all-up-round 
is  launched  from  an  armored  box  launcher 
or  the  vertical  launching  system  (VLS) 
Mk-41.  Both  submarines  and  surface 


ships  have  combat/weapons  control  sys¬ 
tems  to  perform  engagement  planning, 
missile  initialization  and  launch  control 
functions.  Targeting  for  TOMAHAWK  is 
supported  by  the  Theater  Mission  Planning 
System,  which  provides  the  land  targets 
and  overland  missile  navigation  update. 
Targeting  is  also  support  by  the  Over-the- 
Horizon  Detection,  Classification  and  Tar¬ 
geting  (OTH/DC&T)  System,  which  pro¬ 
vides  ship  targets  and  contact  avoidance 
information. 


BACKGROUND 


Development  of  the  sea  launched  cruise 
missile  began  in  1972  with  full-scale  engi¬ 
neering  development  (FSED)  starting  in 
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1977.  Initial  operational  test  and  evalu¬ 
ation  (IOT&E)  began  in  1981. 


OT&E  of  each  TOMAHAWK  missile 
variant  and  the  various  associated  weap¬ 
ons  systems  has  been  preceded  by  a  com¬ 
bined  development  and  operational  test  to 
minimize  the  expenditure  of  test  resources 
while  achieving  both  technical  and  opera¬ 
tional  test  objectives. 


The  final  phases  of  IOT&E  of  the 
TASM  and  TLAM-N  missile  variants  from 
both  submarines  and  surface  ships  were 
completed  in  1984.  In  November  of  that 
year,  the  DOT&E  submitted  his  report  to 
Congress  and  the  Secretary  of  Defense. 
As  required  by  10  U.S.C.  138,  this  report 
was  submitted  prior  to  the  decision  to  in¬ 
crease  the  production  rates  of  the  TASM 
and  TLAM-N  beyond  the  low-rate  initial 
production  (LREP)  level.  The  DOT&E  sub¬ 
mitted  a  similar  report  for  TLAM-C  in 
December  198J. 


OT&E  ISSUES 


Six  pnases  of  testing  on  the  various  com¬ 
ponents  of  the  TOMAHAWK  weapon  sys¬ 
tem  were  completed  during  FY88.  All 
OT&E  was  conducted  in  accordance  with  a 
DOT&E  approved  test  plan.  These  tests 
and  their  major  OT&E  issues  are  as  fol¬ 
lows: 


o  The  final  phase  of  initial  opera¬ 
tional  test  and  evaluation  of  the  TLAM-D 
(OT-ILD,  OFEVAL)  was  conducted  to 
evaluate  the  operational  effectiveness  and 
suitability  of  this  variant  of  the  TOMA¬ 
HAWK  missile.  Specific  operational  ef¬ 
fectiveness  and  operational  suitability  is¬ 
sues  addressed  included:  missile  launch 
performance,  cruise  flight  performance 
and  terminal  accuracy,  reliability,  logistics 


supportabiliiy,  training,  interoperability, 
and  human  factors. 

o  Follow-on  Operational  Test  and 
Evaluation  (FOT&E)  (OT-fflC  Phase  2) 
was  conducted  on  the  Land  Attack  TOMA¬ 
HAWK  weapon  system  Theater  Mission 
Planning  Center  (TMPC)  to  determine  the 
operational  effectiveness  and  suitability  of 
the  TMPC  with  Block  8.1  software.  Phase 
1  of  OT-mC  was  conducted  from  May 
through  July  1987  at  the  Commander-in- 
Chief,  Pacific  TMPC  on  Block  8.0  soft¬ 
ware  and  was  reported  in  the  DOT&E 
FY87  Annual  Report. 

o  FOT&E  (OT-IHB)  was  con¬ 

ducted  at  the  Mk  37  TOMAHAWK  Weap- 
ons  System  (TWS)  to  evaluate  the  opera¬ 
tional  effectiveness  and  operational 
suitability  of  this  weapon  system  as  in¬ 
stalled  on  the  CG-47  class  cruisers  with 
vertical  launching  systems  and  to  verify 
correction  of  deficiencies  from  earlier 
OT&E. 

o  FOT&E  (OT-DID)  was  con¬ 

ducted  on  the  Mk  37  TOMAHAWK  Weap¬ 
ons  System  (TWS)  to  evaluate  the  opera¬ 
tional  eifectiveness  and  operational 
suitability  of  this  weapon  system  as  in¬ 
stalled  on  DD-963  class  destroyers  with  a 
vertical  launching  system  and  to  verify 
correction  of  deficiencies  from  earlier 
OT&E. 

o  FOT&E  (OT-mKl)  was  con¬ 

ducted  on  the  TOMAHAWK  Weapon  Con¬ 
trol  System  (TWCS,  AN/SWG-3)  to  evalu 
ate  the  operational  effectiveness  and 

operational  suitability  of  Block  1  upgrades 
to  the  weapon  control  system  on  a  vertical 
launching  system  ship. 

o  The  second  phase  of  a  Chief  of 
Naval  Operations  project  was  conducted 
on  the  OTH/DC&T  system.  The  first 
phase  was  conducted  in  the  Atlantic  Fleet 
operating  area  in  August  1986,  and  re¬ 
ported  in  the  DOT&E  FY87  Annual  Re- 
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port.  The  second  phase  was  conducted  in 
the  Pacific  Fleet  operating  area  to  deter¬ 
mine  the  effectiveness  and  operational 
suitability  of  the  Pacific  Fleet  system  in 
targeting  cruise  missiles  and  other  weap¬ 
ons  at  over-the-horizon  ranges. 

OT&E  ASSESSMENT 

The  TLAM-D  OPEVAL  consisted  of  five 
test  firings  at  the  Pacific  Missile  Test  Cen¬ 
ter  from  April  8  to  May  27,  1988.  The 
testing  consisted  of  three  operational  fir¬ 
ings  (two  from  a  submarine  and  one  from 
a  surface  ship)  and  two  combined  devel¬ 
opment  and  operational  test  (DT/OT)  fir¬ 
ings  (both  from  surface  ships).  The  test 
firings  were  augmented  by  seven  simu¬ 
lated  engagement  planning  and  missile 
launch  tests.  The  Navy’s  independent  op¬ 
erational  test  agent,  Commander,  Opera¬ 
tional  Test  and  Evaluation  Force  (COM- 
OPTEVFOR)  determined  that  the 
TLAM-D  was  potentially  operationally  ef¬ 
fective  and  operationally  suitable.  The 
most  significant  effectiveness  deficiencies 
were  not  associated  with  the  missile  but 
with  mission  planning  and  weaponeering. 

FOT&E  (OT-fflC  Phase  2)  on  the 
Theater  Mission  Planning  Center  (TMPC) 
with  Block  8.1  software  was  conducted  at 
the  Commander-in-Chief,  Atlantic  TMPC 
from  February  through  May  1988.  A  total 
of  12  missions  was  planned.  Six  missions 
were  planned,  four  primary  and  two  alter¬ 
nate,  in  conjunction  with  the  TLAM-D 
OPEVAL  to  assess  the  capability  of  the 
TMPC  to  properly  target,  task,  weaponeer 
and  plan  TLAM-D  missions.  Two  other 
missions  were  planned  in  conjunction  with 
the  Navy’s  operational  test  launch  (OTL) 
program,  one  TLAM-C  (OTL-50)  and 
one  Tf  AM-N  (OTL-41Q).  Four  missions 
were  andomly  selected  to  actual  opera¬ 
tional  are«?s,  two  TLAM-C  and  two 
TLAM-N.  The  tet-vu  g  was  limited  in  that 
the  number  of  missions  produced  and 
flown  was  insufficient  for  a  valid  compari¬ 
son  with  mission  effectiveness  require¬ 


ments.  COMOPTEVFOR  concluded  that 
the  TMPC  with  Block  8.1  software  has  the 
potential  to  be  operationally  effective  and 
operationally  suitable.  However,  major 
improvements  are  needed  in  the  area  of 
documentation,  procedures,  and  training. 
In  addition,  a  better  understanding  of  the 
conventional  land  attack  TOMAHAWK 
limitations  in  all  environmental  and  geo¬ 
graphic  conditions  needs  to  be  developed 
and  promulgated. 

Follow-on  operational  test  and  evalu¬ 
ation  (FOT&E)  (OT-mB)  on  the  Mk  37 
TOMAHAWK  weapons  system  as  installed 
on  the  CG-47  class  cruisers  with  vertical 
launching  systems  was  conducted  in  USS 
Antietam  (CG-54)  at  the  Pacific  Missile 
Test  Center  (PMTC)  from  April  11  to  24, 
1988.  The  testing  consisted  of  three  mis¬ 
sile  firings.  The  test  was  limited  in  that  a 
system  operability  test  (SOT)  for  the  Mk 
37  TWS  does  not  exist  and  therefore  could 
not  be  evaluated.  The  launcher  control 
group  (LCG)  of  the  Mk  37  TOMAHAWK 
weapons  control  system  (TWCS)  properly 
initialized  all  three  missiles,  and  the  mis¬ 
siles  flew  their  intended  flight  path  to  the 
target  area.  In  order  to  increase  the  Mk 
37  reliability  data  base,  the:  results  of  the 
testing  on  Antietam  and  USS  Spruance 
(DD-963)  (see  OT-IHD  below)  were  com¬ 
bined.  COMOPTEVFOR  concluded  that 
the  Mk  37  installed  in  a  CG-47  class 
cruiser  with  vertical  launching  systems  is 
operationally  effective  and  potentially  op¬ 
erationally  suitable.  Full  fleet  introduction 
was  recommended  following  correction  of 
the  reliability  problems  in  the  TWCS  and 
a  safety  problem  (potential  finger  injury) 
with  slide  release  buttons  on  a  computer 
cabinet. 

FOT&E  (OT-mD)  on  the  Mk  37 
TOMAHAWK  weapons  system  as  installed 
on  DD-963  class  destroyers  with  a  vertical 
launching  system  was  conducted  in  USS 
Spruance  from  March  21  to  27,  1988,  dur¬ 
ing  the  transit  to  and  at  the  Eglin  Air 
Force  Base  Sea  Range  off  Florida.  The 
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testing  consisted  on  12  nonfiring  TASM 
engagements  and  one  TLAM-N  firing. 
The  test  was  limited  in  that  a  system  oper¬ 
ability  test  (SOT)  for  the  Mk  37  does  not 
exist  and  therefore  could  not  be  evaluated. 
The  launcher  control  group  of  the  TWCS 
properly  initialized  the  missile  and  it  flew 
its  intended  flight  path  to  the  target  area. 
COMOFTEVFOR  concluded  that  the  Mk 
37  installed  in  a  DD-963  class  destroyer 
with  a  vertical  launching  system  is  opera¬ 
tionally  effective  and  potentially  operation¬ 
ally  suitable.  Full  fleet  introduction  was 
recommended  following  correction  for  the 
reliability  problems  in  the  TWCS  and  the 
safety  problem  discussed  in  the  above 
paragraph. 

FOT&E  (OT-mHl)  on  the  Block  1 
software  upgrades  to  the  TOMAHAWK 
weapon  control  system  on  a  vertical 
launching  system  ship  (TWCS,  AN/ 
SWG-3)  was  conducted  on  Spruance  dur¬ 
ing  the  OT-IBCD  operations  described 


above  and  on  Antietam  from  December  13 
to  December  15  ,  1988,  at  PMTC.  The 
Antietam  testing  consisted  of  four  nonfiring 
TASM  engagements  and  one  actual  TASM 
firing.  The  Block  1  upgrade  demonstrated 
the  capability  to  support  missile  employ¬ 
ment  in  the  operations  on  both  ships. 
COMOPTEVFOR  recommended  the  Block 
1  Software  Upgrade  be  approved  for  full 
fleet  introduction  after  the  cause  of  the 
TWCS  reliability  problems  is  corrected. 

The  second  phase  of  Chief  of  Naval 
Operations  project  K310-5  on  the  OTH/ 
DC&T  system  was  conducted  in  the  east¬ 
ern  Pacific  Fleet  operating  area  from  July 
26-31,  1988.  The  project  was  a  test  of  the 
Navy’s  ability  to  provide  a  composite  tacti¬ 
cal  surface  picture  adequate  to  support  the 
employment  of  cruise  missiles  and  other 
extended  range  weapons.  The  results  of 
this  project  are  still  being  analyzed  and 
will  be  reported  in  the  DOT&E  FY89  An¬ 
nual  Report. 
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SYSTEM  DESCRIPTION 


The  ALCM  is  an  air-to-ground  subsonic 
missile  designed  for  launch  with  a  nuclear 
warhead  from  aircraft.  The  missile  is 
powered  by  a  small  turbofan  engine  in  the 
600-pound  thrust  category.  Missile  navi¬ 
gation  is  accomplished  by  an  inertial  navi¬ 
gation  system  augmented  by  a  terrain  cor¬ 
relation  (TERCOM)  technique  using 
digital  terrain  mapping.  It  is  capable  of 
flying  mid-altitude,  cruise  and  low-alti¬ 
tude  terrain  following  (TF)  missions.  The 
vALCM  will  fly  programmed  flight  paths  at 
commanded  flight  modes,  speeds,  and  al¬ 
titudes.  The  B-52  can  carry  a  total  of  20 
ALCMs,  12  externally,  with  6  on  each  of  2 
wing  pylons,  and  8  internally  on  a  rotary 


launcher  (CSRL),  which  is  scheduled  for 
deployment  on  the  B-52H  in  FY90. 

BACKGROUND 

The  program  was  initiated  in  February 
1974  and  a  production  decision  was  made 
for  the  ALCM  in  April  1980.  Initial  op¬ 
erational  capability  with  the  first  opera¬ 
tional  B-52G  squadron  at  Griffis  AFB, 
New  York,  was  declared  in  December 
1982.  A  requirement  for  more  realistic 
operational  testing  during  the  follow-on 
operational  test  and  evaluation  (FOT&E) 
conducted  by  the  Strategic  Air  Command 
(SAC)  led  to  a  Canadian-US  agreement 
for  operational  testing  over  the  more  op¬ 
erationally  representative  Canadian  ter¬ 
rain.  The  first  ALCM  test  launches  over 
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Canada  were  completed  on  February  19 
and  25,  1985.  SAC’s  FOT&E  program 
will  continue  for  the  life  of  the  missile.  Al¬ 
though  this  program  does  not  include  any 
further  major  acquisition,  DOT&E  over¬ 
sight  continues  because  of  the  importance 
of  cruise  missile  weapons. 

OT&E  ISSUES 

Phase  il  of  SAC’s,  FOT&E  of  the  ALCM, 
began  in  July  1983  and  will  continue 
throughout  the  system’s  life.  The  critical 
operational  issues  as  defined  in  the  Test 
and  Evaluation  Master  Plan  (TEMP),  ap¬ 
proved  by  OSD  in  April  1988  are:  (1)  as¬ 
sess  B-52  Integrated  Weapon  System 
(IWS)/ALCM  accuracy  and  reliability  us¬ 
ing  the  entire  stockpile-to-target  se¬ 
quence,  (2)  assess  SAC’s  mission  plan¬ 
ning  capability  to  support  the  B-52 
Offensive  Avionics  System  (OAS)  and  the 
ALCM,  and  (3)  demonstrate  ALCM  global 
cruise.  Specific  test  objectives  are  de¬ 
signed  to  (1)  provide  inputs  to  SAC  plan¬ 
ners  in  determining  weapon  system  accu¬ 
racy  and  reliability;  (2)  verify  current 
operational  employment  concepts,  tactics, 
and  techniques,  and  identify  operational 
deficiencies;  (3)  verify  adequacy  of  techni¬ 
cal  data  and  equipment  used  in  mainte¬ 
nance,  check-out,  and  operation  of  the 
weapon  system — including  aircrew,  soft¬ 
ware,  hardware,  and  the  mission  planning 
system;  (4)  evaluate  performance  of  the 
weapon  system — to  include  aircrew,  soft¬ 
ware,  hardware,  and  the  mission  planning 
system;  and  (5)  continue  evaluation  of 
those  areas  recommended  as  a  result  of 
previous  testing. 

OT&E  ACTIVITY 

SAC  continues  to  conduct  the  ALCM 
FOT&E  program.  As  of  October  1,  1988, 
70  ALCM  FOT&E  launches  had  been  ac¬ 
complished.  Fifteen  of  these  launches  oc¬ 
curred  during  AFOTEC-conducted  Phase 
I  FOT&E  from  July  1981  through  June 
1983.  The  remaining  55  launches  have 
been  SAC-conducted  Phase  n  FOT&E 
tests  (July  1983  through  September  1988). 
Of  the  10  ALCM  test  missions  flown  in 


FY88,  two  were  over  the  Canadian  Test 
Route,  and  the  remaining  eight  were  flown 
over  US  routes.  Test  results  are  reported 
annually  in  SAC’s  B-52  Integrated 
Weapon  System  Follow-on  Operational 
Test  Report  and  SAC’s  evaluation  of 
ALCM  performance,  which  is  provided  to 
the  Joint  Chiefs  of  Staff.  A  total  of  10 
flights  are  scheduled  for  FY89,  with  one 
through  Canadian  air  space. 

OT&E  ASSESSMENT 

To  date,  ALCM  operational  performance, 
as  demonstrated  by  FOT&E,  has  met 
SAC’s  requirements  for  suitability,  reli¬ 
ability,  and  maintainability.  The  testing 
accomplished  in  FY88  did  not  significantly 
alter  the  results  reported  during  previous 
years.  B-52  OAS  Block  n  was  tested  for 
the  first  time  during  FOT&E  Phase  II  in 
FY88.  Block  II  of  the  Offensive  Avionics 
System  represents  another  significant  im¬ 
provement  in  the  OAS/ALCM  weapon  sys¬ 
tem.  The  two  Canadian  ALCM  flights  in 
January  1988  met  all  their  test  objectives 
and  were  completely  successful.  Overall, 
the  B-52  OAS/ALCM  weapon  system  con¬ 
tinues  to  be  highly  accurate  and  is  meeting 
SAC’s  operational  requirements.  Last 
year’s  DOT&E  direction  that  the  Air  Force 
review  ALCM  test  planning  resulted  in  im¬ 
provements  to  several  areas  of  the  pro¬ 
gram,  including  mission-planning  capabil¬ 
ity,  analysis  methodologies,  and  a 
coherent  approach  to  testing  of  the  entire 
class  of  weapons  throughout  their  life  cy¬ 
cles. 

SUMMARY 

ALCM  operational  performance  demon¬ 
strated  by  this  FOT&E  program  shows  that 
the  ALCM  continues  to  perform  satisfac¬ 
torily  and  has  met  specifications  in  suit¬ 
ability,  reliability,  and  maintainability.  All 
10  flights  accomplished  in  FY88  were  suc¬ 
cessful,  including  two  important  free- 
flight  missions  over  Canada.  Important  re¬ 
sults  achieved  from  recent  testing  confirm 
significant  improvements  in  the  B-52 
OAS/ALCM  weapon  system. 
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SYSTEM  DESCRIPOON 

The  High  Speed  Anti-Radiation  Missile 
(HARM)  is  an  air-to-surface  missile  de¬ 
signed  to  suppress  or  destroy  land-and 
sea-based  radars  that  direct  enemy  air  de¬ 
fense  systems.  HARM  is  a  design  evolu¬ 
tion  of  ARM  weapons  (Shrike  and 
Standard  ARM)  and  is  the  primary 
weapon  used  on  the  F-4G  Wild  Weasel 
defense  suppression  weapon  system.  Per¬ 
formance  characteristics  include:  high 
speed,  large  footprint,  high  sensitivity  to 
weak  signals,  ana  software  adaptability  to 
the  constantly  changing  threat.  HARM 


weighs  807  pounds.  It  is  164  inches  long 
and  10  inches  in  diameter. 

BACKGROUND 

Joint  Navy  (lead  service)/Air  Force  initial 
operational  testing  of  HARM  began  in 
1979  and  resulted  in  full  production  and 
USAF  initial  operational  capability  in  Sep¬ 
tember  1984.  Missile  deficiencies  identi¬ 
fied  in  testing  are  being  addressed  through 
a  performance  upgrade  program  and 
tested  in  follow-on  operational  test  and 
evaluation  (FOT&E). 
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OT&E  ISSUES 

Critical  operational  issues  include  guid¬ 
ance  to  within  warhead  lethal  radius,  ca¬ 
pability  to  switch  to  alternate  targets, 
targeting  reaction  time,  effectiveness  in 
multipath  environment,  aircrew  workload, 
fratricide  avoidance,  ECCM  environment 
capability,  maintainability/reliability  built- 
in  test  function  and  logistical  support  ca¬ 
pability. 

OT&E  ACTIVITY 

The  version  currently  being  fielded  is 
called  the  Block  n.  Testing  of  the  next 
software  version  (Block  m)  began  in  De¬ 
cember  1988.  The  next  hardware/soft¬ 
ware  version  (Block  IV)  will  be  competed 
against  a  low  cost  seeker  (LCS)  version 
made  by  a  second  source.  These  versions 
will  start  developmental  testing  in  early 
1989  and  operational  testing  in  FY90. 
The  Navy-submitted  Test  and  Evaluation 
Master  Plans  (TEMPs)  for  Block  HI  and 
LCS  were  reviewed  and  approved  by 
DOT&E  in  November  1988.  The  Block  m 
test  plan  was  recently  approved  for  the 
Navy  portion  of  the  test. 

OT&E  ASSESSMENT 

The  first  phase  of  FOT&E  was  completed 
in  November  1984.  It  consisted  of  one 


missile  firing  to  verify  software  correc¬ 
tions.  The  second  phase  of  FOT&E  on  the 
Block  n  began  in  February  1986.  This  Air 
Force  phase  was  finished  and  reported  on 
in  January  1988.  It  included  four  missile 
firings  and  an  extensive  captive-carry 
flight  program.  The  Air  Force  found  sev¬ 
eral  problems  that  led  to  the  Block  m  ver¬ 
sion  which  will  be  tested  soon.  Flight 
testing  was  conducted  on  test  ranges  at 
Nellis  AFB,  Nevada,  and  the  Naval  Weap¬ 
ons  Center,  China  Lake,  California. 

SUMMARY 


HARM  operational  testing  has  been  con¬ 
ducted  continuously,  with  the  Air  Force 
and  Navy  doing  separate  portions  of  each 
phase.  Each  Service  has  been  critically 
assessing  its  own  needs,  and  the  resulting 
changes  to  the  deficiencies  are  strengthen¬ 
ing  the  system.  User  requirements  for 
each  service  are  not  cotally  met  at  this 
time,  but  fixes  and  tests  of  fixes  indicate 
that  the  full  requirements  could  be  met  in 
these  new  versions.  There  are  well- 
planned  tests  scheduled  for  the  Block  m, 
Block  IV,  and  LCS  versions. 
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SYSTEM  DESCRIPTION 

The  Advanced  Medium  Range  Air-to-Air 
Missile  (AMRAAM)  is  the  next  generation 
all-weather,  all-environment,  medium- 
range  air-to-air  missile  system  for  use  by 
the  Air  Force,  Navy,  ana  NATO  forces. 
AMRAAM  is  designed  to  be  employed 
within  and  beyond  visual  range.  It  is  in¬ 
tended  to  provide  more  firepower  and 
combat  utility  and  effectiveness  than  the 
AM-7  Sparrow,  which  it  is  to  replace, 
while  significantly  reducing  aircraft  and 
aircrew  vulnerability.  Increased  average 
missile  velocity  provides  the  capability  to 
outshoot  threat  aircraft  by  increasing  the 
separation  between  the  launch  aircraft  and 
the  target  at  AMRAAM  intercept.  The 
AMRAAM’ s  active  radar  seeker  will  pro¬ 
vide  a  launch-and-maneuver  capability 


for  increased  survivability  and  multiple 
target  engagement  on  a  single  intercept. 

BACKGROUND 

The  AMRAAM  program  responds  to  a 
1978  Joint  System  Operational  Require¬ 
ment.  Full-scale  development  (FSD)  was 
initiated  in  December  1981,  and  a  follower 
contractor  was  selected  in  July  1982. 
Schedule  delays  and  cost  increases  slowed 
the  program,  leading  to  an  OSD-directed 
investigation  of  alternative  methods  for  re¬ 
ducing  AMRAAM  costs  in  January  1985. 
In  June  1985,  the  Secretary  of  Defense  ap¬ 
proved  a  revised  program’,  which  incorpo¬ 
rated  cost-reduction  measures  and  set 
cost  caps.  The  FY86  National  Defense 
Authorisation  Act  required  Secretary  of 
Defense  cost  certification  of  the  Air  Force 
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production  program  at  $5.2  billion  in 
FY84  dollars,  and  a  full-scale  develop¬ 
ment  contract  limit  of  $556  million.  The 
FY87  Authorization  Act  capped  the  pro¬ 
gram  at  $7.0  billion  for  24,000  Air  Force 
and  Navy  missiles,  but  allowed  adjustment 
due  to  congressional  actions.  The  concur¬ 
rent  development  test/operational  test 
(DT/OT)  program  had  accomplished  81 
firings  through  November  1988.  In  No¬ 
vember  1988,  the  Defense  Acquisition 
Board  (DAB)  recommended  continued 
low-rate  production  and  the  release  of 
long-lead  funds  for  Ix>t  DI  missiles. 

OT&E  ISSUES 


Critical  operational  issues  include  autono¬ 
mous  employment  (“launch  and  leave”), 
multiple  kills  per  engagement,  selected 
target  kill  in  multiple  formation,  capability 
against  maneuvering  targets,  effectiveness 
in  the  electronic  combat  arena,  aircrew 
work  load,  and  reliability  and  maintain¬ 
ability.  Specific  objectives  in  each  of 
these  areas  are  designed  to  ensure  that 
this  weapon  will  meet  the  exacting  de¬ 
mands  of  the  next  generation  of  air-to-air 
weapons. 

OT&E  ACTIVITY 


AMRAAM  initial  operational  test  and 
evaluation  (IOT&E)  began  in  October 
1985  with  the  start  of  the  Captive  Carry 
Reliability  Program,  Phases  I  and  n 
(CCRP  I  and  II).  The  initial  operational 
test  and  evaluation  (IOT&E)  portion  of 
combined  AMRAAM  DT/OT  FSD  is  cur¬ 
rently  being  conducted  by  the  Air  Force 
Operational  Test  and  Evaluation  Center 
(AFOTEC).  The  IOT&E  objectives  will  be 
evaluated  using  data  from  both  develop¬ 
ment  test  and  evaluation  (DT&E)  and 
IOT&E  tests,  including:  (1)  mathematical 
modeling  and  simulations,  (2)  maintain¬ 
ability  demonstrations,  (3)  three  phases  of 
CCRP,  (4)  AMRAAM  captive  equipment 


(ACE)  missions,  and  (5)  live  missile  fir¬ 
ings. 

All  phases  of  testing  are  currently  un¬ 
derway.  The  modeling/simulation  effort 
and  maintainability  demonstrations  have 
been  conducted  since  the  beginning  of 
FSD.  Hardware-in-the-loop  (HIL)  simu¬ 
lations  have  been  used  primarily  to  sup¬ 
port  software  development  and  the  live- 
fire  program;  however,  separate 
evaluations  have  been  performed  using  18 
predefined  scenarios  to  explore  several 
missile  capabilities.  CCRP  II  was  com¬ 
bined  DT&E/IOT&E  involving  AMRAAM 
carriage  on  the  F-16.  CCRP  m  is  a  sepa¬ 
rate  IOT&E  evaluation  of  F-15  carriage. 
The  IOT&E  ACE  missions  began  in  Octo¬ 
ber  1986  as  part  of  the  preparation  for  the 
first  IOT&E  live  firing  on  October  16, 
1986.  Ninety  missile  firings  were  origi¬ 
nally  planned  for  FSD,  25  of  which  were 
to  be  dedicated  IOT&E  launches. 

The  missiles  used  through  most  of  DT/ 
OT  are  FSD  production  representative 
missiles.  The  last  four  missiles  in  opera¬ 
tional  tests,  and  the  additional  missiles 
needed  for  test  refire,  will  be  Lot  1  pro¬ 
duction  missiles. 


DOT&E  travels  to  and  observes  all 
OT&E  profile  and/or  live-fire  missions. 
All  changes  to  IOT&E  shot  profiles  are  re¬ 
viewed  by  DOT&E  to  ensure  that  there  are 
no  losses  in  OT&E  “flavor.”  DOT&E  is 
briefed  prior  to  all  reviews  and  DAB  meet¬ 
ings,  and  is  closely  monitoring  the  final 
phases  of  this  IOT&E.  The  updated  Test 
and  Evaluation  Master  Plan  (TEMP)  i~  un¬ 
der  -review  at  this  writing. 

DOT&E  has  requested  a  “user”  evalu¬ 
ation  of  the  tactical  utility  of  AMRAAM. 
Tactical  Air  Command  will  be  conducting 
this  operational  utility  evaluation  (OUE)  at 
Nellis  AFB,  Nevada,  in  early  1989.  It  will 
include  flying  and  computer  simulations, 
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with  a  strong  emphasis  on  collection  and 
evaluation  of  flight  data, 

OT&E  ASSESSMENT 

As  of  this  writing,  14  operational  live-fire 
missions  have  been  accomplished  in 
IOT&E  since  October  1986,  with  18  of  the 
scheduled  25  missiles  launched.  CCRP  II 
was  completed  in  FY87  with  800  hours 
carriage  on  the  F-16.  CCRP  HI,  F-15  car¬ 
riage,  was  delayed  from  FY87,  started  in 
April  1988,  and  suspended  in  September 
due  to  reliability  failures.  It  was  resched¬ 
uled  to  start  again  in  December  1988. 

IOT&E  is  now  estimated  to  be  com¬ 
pleted  in  mid-1939,  approximately  a  year 
behind  the  June  1987  DAB  schedule. 
Many  things  have  contributed  to  the  delay, 
including  drone  targets,  ECM  pods,  air¬ 
craft  software,  aircraft  availability,  and 
range  problems.  Currently,  however, 
problems  with  AMRAAM  system  software 
maturity,  missile  reliability,  and  some  per¬ 
formance  issues  (c.g.,  ECCM  and  multiple 


targets)  are  responsible.  A  May  1988  pro¬ 
gram  review  and  a  subsequent  September 
1988  follow-up  review  of  AMRAAM  test 
progress  resulted  in  DAB  endorsement  of 
the  DOT&E’s  recommendation  of  contin¬ 
ued  low-rate  instead  of  full-rate  produc¬ 
tion.  The  Lot  3  (originally  intended  to  be 
full-rate  production)  amount  was  de¬ 
creased  from  1270  to  900  missiles. 
IOT&E  is  continuing  as  corrections  to  ob¬ 
served  deficiencies  become  available  for 
testing. 

SUMMARY 

The  AMRAAM  program  is  significantly 
behind  its  original  schedule,  and  the  full- 
rate  production  decision  has  been  delayed 
until  changes/fixes  can  be  accomplished 
and  tested.  As  deficiency  corrections  are 
incorporated,  schedule  delays  reflect  the 
risk  involved  in  doing  concurrent  DT/OT. 
Missile  reliability,  ECCM,  multiple  tar¬ 
gets,  and  software  maturity  are  the  major 
concerns  for  which  corrections  have  been 
identified,  but  these  remain  to  be  tested. 
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SYSTEM  DESCRIPTION 

The  AN/ALQ-621  RWR  is  a  major  up¬ 
grade  to  the  AN/ALR  -62  used  on  die 
F-lll  and  incorporates  capabilities  to  en¬ 
sure  effectiveness  in  the  1990s.  The  AN/ 
ALR-62I  is  used  in  conjunction  with  the 
AN/ALQ-137  jammer. 


OT&E  ISSUES 

Major  effectiveness  issues  are  related  to 
threat  detection,  identification,  response 
time,  azimuth  accuracy,  and  inter¬ 
operability  with  other  on-board  avionics 
and  friendly  aircraft.  Major  suitability  is¬ 
sues  are  related  to  reliability,  maintain¬ 
ability,  and  software  supportability. 


OT&E  ACTIVITY 

The  Air  Force  evaluated  the  operational 
effectiveness  and  suitability  of  the  AN/ 
ALR-62I  on  six  effective  sorties  and  8.3 
total  flying  hours  combined  with  develop¬ 
ment  test  results. 

OT&E  ASSESSMENT 

The  Air  Force  assessed  the  system  as 
meeting  operational  effectiveness  and  suit¬ 
ability  criteria  and  awarded  a  production 
contract  based  on  this  assessment.  The 
DOT&E  added  the  AN/ALR-62I  to  our 
oversight  list  in  September  1988.  Our  re¬ 
view  of  the  operational  test  results  pro¬ 
vided  by  the  Air  Force  indicates  that, 
while  the  AN/ALR-62I  significantly 
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increases  the  capability  against  current 
threats  and  threat  densities,  there  are  ar¬ 
eas  of  continuing  concern.  Interoperability 
with  the  AN/ALQ-137  needs  to  be  im¬ 
proved  prior  to  fielding  the  system.  Auto¬ 


matic  software  restarts  need  to  be  re¬ 
duced.  The  operational  tests  were  limited 
by  unavailable  support  equipment  and  re¬ 
quired  extensive  development  contractor 
support. 
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AN/ALQ-131  BLOCK  II  AND  RECEIVER  PROCESSOR 


AN/ALQ-131  BLOCK  II 
AND  RECEIVER 
PROCESSOR 


SYSTEM  DESCRIPTION 

The  AN/ALQ-131  Block  II  with  the  Re¬ 
ceiver/Processor  (R/P)  Electronic  Counter¬ 
measures  (ECM)  Pod  is  a  modular  self¬ 
protection  jamming  system  designed  to 
protect  tactical  aircraft  against  a  variety  of 
radar  threats.  The  AN/ALQ-131  Block  II 
with  R/P  is  a  major  upgrade  to  the  cur¬ 
rently  deployed  AN/ALQ-131  Block  I  and 
Block  II  pods  and  is  one  of  two  Air  Force 
ECM  pod  configurations.  The  R/P  pro¬ 
vides  automatic,  power-managed,  tech¬ 
nique  tailored  pod  operation  based  on  re¬ 
ceived  threat  signals  and  threat  density. 
Support  equipment  at  the  intermediate 
level  (I-Level)  for  the  AN/ALQ-131  Block 
n  is  provided  by  contractor-developed  en¬ 
gineering  test  support  equipment  (ETSE). 


The  Air  Force  has  not  acquired  final  auto¬ 
matic  test  equipment  (ATE). 

BACKGROUND 

The  AN/ALQ-131  Block  II  was  operation¬ 
ally  tested  in  FY87,  and  the  results  were 
reported  in  the  FY87  DQT&E  Annual  Re¬ 
port.  The  R/P  wa 6  tested  in  1985.  Over 
300  units  of  each  have  been  procured. 

OT&E  ISSUES 

The  purpose  of  current  operational  tests  is 
to  assess  the  enhanced  operational  effec¬ 
tiveness  and  operational  suitability  of  the 
AN/ALQ-131  Block  II  with  R/P  over  that 
of  the  AN/ALQ-131  Block  II  and  with  re¬ 
spect  to  the  Air  Force  statement  of  need 
for  electronic  warfare  systems.  Six  effec- 
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tiveness  issues  and  five  suitability  issues 
will  be  addressed.  The  issues  relate  to  in¬ 
terface  considerations,  increased  capabil¬ 
ity,  weapon-system  compatibility,  and  reli¬ 
ability  of  the  integrated  system. 

OT&E  ACTIVITY 

A  quick-look  flight  test  was  conducted  at 
Eglin  AFB,  Florida,  to  verify  techniques. 
Ground  simulations  at  the  Air  Force  Elec¬ 


tronic  Warfare  Evaluation  Simulator 
(AFEWES),  Fort  Worth,  Texas,  were  com¬ 
pleted.  Further  flight  tests  at  Eglin  AFB 
and  Tyndall  AFB  are  scheduled  For  1989. 

OT&E  ASSESSMENT 

Insufficient  data  analysis  has  been  accom¬ 
plished  to  provide  an  assessment  at  this 
time 
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SYSTEM  DESCRIPTION 

The  AN/ALQ-161  system  is  the  internally 
mounted  electronic  countermeasures  sys¬ 
tem  for  the  B-1B.  It  includes  the  tail  warn¬ 
ing  function  (TWF)  and  the  countermea¬ 
sures  dispenser  function  as  well  as  radar 
warning  receiver  and  jamming  functions. 
Like  the  tactical  systems,  the  AN/ 
ALQ-161  is  reprogrammable.  The  MOD 
1  Block  4.0  system  has  completed  develop¬ 
ment  tests. 


being  developed  to  determine  operational 
capabilities  of  the  existing  design.  The 
DOT&E  ha?  uirecteri  the  Air  Force  to  per¬ 
form  operational  test*  on  each  element  of 
the  AN/ALQ-161  system  certified  by  the 
system  program  officer  as  ready  for  de¬ 
ployment.  Certification  of  the  TWF,  dis¬ 
penser,  and  Block  4.0  system  are  expected 
in  1989. 

OT&E  ASSESSMENT 


OT&E  ISSUES 

Because  the  AN/ALQ-161  does  not  meet 
SAC  requirements,  operational  tests  are 


The  Air  Force  development  activity  has 
provided  an  assessment  of  the  reduced- 
capability  system.  No  operational  tests 
have  been  accomplished  to  date. 
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SYSTEM  DESCRIPTION 

The  AN/ALQ-172  (V2)  countermeasures 
set  is  a  power  managed,  software 
reprogrammable  system  that  is  a  major 
upgrade  to  th?  AN/ALQ-117  system  used 
on  the  B-52.  The  V2  is  installed  on  the 
B-52H.  Requirements  for  the  V2  are  in 
SAC  Statements  of  Operational  Need  3-79 
and  10-81. 

BACKGROUND 

Significant  advances  in  Soviet  surface-to- 
air  antiaircraft  missiles  and  airborne  inter¬ 
ceptor  systems  threatened  the  potential 
mission  effectiveness  of  the  B-52  and  dic¬ 
tated  an  upgrade  in  countermeasures  ca¬ 
pability.  An  Under  Secretary  of  Defense 


AN/ALQ-172  (V2) 


for  Research  and  Engineering  Memoran¬ 
dum  of  June  19,  1981,  directed  service 
electronic  warfare  progtam  managers  to 
exercise  acquisition  strategies  tailored  to 
react  immediately  to  counter  these  new 
and  projected  threats. 

OT&E  ISSUES 

The  FY88  Follow-on  Test  and  Evaluation 
hi"*  the  singular  issue  of  assessing  the  ef- 
sctivetiwas  of  the  AN/ALQ-172  (V2) 
against  advanced  threats. 

OT&E  ACTIVITY 

Operational  tests  were  conducted  between 
February  1,  1988,  and  March  30,  1988. 
All  test  activity  originated  at  B-52  main 
operating  bases  and  returned  to  the  same 
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base.  Eglin  AFB,  Florida,  was  the  test 
range. 

OT&E  ASSESSMENT 

The  Air  Force  determined  that  the  AN/ 
AJLQ-172  (V2)  was  effective  against  the 
threat  as  tested,  an  assessment  with  which 
this  office  concurs. 
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SYSTEM  DESCRIPTION 

The  AN/ALQ-184  Electronic  Countermea¬ 
sures  (ECM)  Pod  is  a  modular  self-protec¬ 
tion  jamming  system  designed  to  protect 
tactical  aircraft  against  a  variety  of  radar 
threats.  The  AN/ALQ-184  is  a  major  up¬ 
grade  to  the  currently  deployed  AN/ 
ALQ-119  pod  and  is  one  of  two  Air  Force 
ECM  pod  configurations.  Support  equip¬ 
ment  at  the  intermediate  level  (I-Level) 
for  the  AN/ALQ-184  is  designated  the 
AN/ALM-233.  The  AN/ALM-233  is  an 
upgrade  to  the  AN/ALM-126  currently  de¬ 
ployed  with  the  AN/ALQ-119. 


BACKGROUND 

The  Air  Force  Statement  of  Operational 
Need  (SON)  TAF  304-80  defines  the  re¬ 
quirement  for  the  AN/ALQ-184.  Feasibil¬ 
ity  studies  started  in  1979,  and  develop¬ 
mental  efforts  started  in  1981. 
Operational  flight  tests  were  conducted 
from  March  1987  to  November  1987  at 
Eglin  AFB,  Florida,  Tyndall  AFB,  Florida, 
and  the  Naval  Weapons  Center,  China 
Lake,  California.  Five  developmental 
items  and  70  QRC  units  had  been  pro¬ 
cured  prior  to  the  operational  tests.  The 
results  of  the  operational  tests  were  to  pro¬ 
vide  an  assessment  prior  to  procurement 
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of  an  additional  100  units  in  1988,  with 
additional  units  to  be  procured  later.  Ex¬ 
tensive  simulator  testing  at  the  Air  Force 
Electronic  Warfare  Evaluation  Simulator 
(AFEWES),  Fort  Worth,  Texas,  and  at  the 
Pacific  Missile  Test  Center,  Point  Mugu, 
California,  was  conducted  prior  to  these 
tests. 

OT&E  ISSUES 

The  purpose  of  the  operational  tests  was 
to  compare  the  enhanced  operational  ef¬ 
fectiveness  and  operational  suitability  of 
the  AN/ALQ-184  and  the  AN/ALM-233 
to  that  of  the  AN/ALQ-119  and  AN/ 
ALM-126  with  respect  to  the  Air  Force 
statement  of  operational  need  for  elec¬ 
tronic  warfare  systems.  The  operational 
tests  had  15  objectives,  '[he  six  major  ob¬ 
jectives  were:  (1)  evaluate  the  capability 
to  provide  tactical  aircraft  selfprotection, 
(2)  assess  reliability,  (3)  assess  maintain¬ 
ability,  (4)  assess  the  built-in-test  (BIT), 
(5)  evaluate  the  reprogrammability  of  the 
pod,  and  (6)  assess  the  suitability  of  the 
AN/ALM-233  support  equipment. 

OT&E  ACTIVITY 

Operational  tests  were  conducted  between 
March  30,  1987,  and  November  17,  1987, 
on  F-16C,  A-10,  F-4E  and  F-4G  aircraft. 


Resource  constraints  precluded  testing  all 
possible  aircraft  configurations  and  flight 
profiles.  Consequently,  the  configuration 
and  profiles  were  selected  as  representa¬ 
tive  of  the  operational  environment  and 
commensurate  with  the  purpose  of  the  op¬ 
erational  tests. 

OT&E  ASSESSMENT 

The  Air  Force  assessed  the  AN/ALQ-184 
as  significantly  more  reliable  and  main¬ 
tainable  than  the  AN/ALQ-119.  The  BIT 
performed  as  required,  and  the  AN/ 
ALM-233  could  be  operated  by  Air  Force 
personnel  and  was  effective  and  suitable 
as  support  equipment  for  the  pod.  The 
pod  demonstrated  its  capability  to  be 
reprogrammed  on  the  flight  line  with  a 
memory  loader  verifier;  however,  the  Air 
Force  does  not  have  an  on-line  capability 
to  implement  this  capability  fully.  The 
system  was  as  effective  as  the  AN/ 
ALQ-119,  but  did  not  meet  the  criteria 
identified  in  the  statement  of  operational 
need.  DOT&E  recommended  that  the  Air 
Force  not  proceed  with  low-rate  initial 
production  (LRIP)  until  the  effectiveness 
deficiencies  were  corrected  and  retested. 
The  Air  Force  procured  100  LRIP  systems 
in  1988  and  intends  to  procure  40  addi¬ 
tional  LREP  systems  in  1989. 
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AN/ALR-56M  AND  AN/ALR-74 


SYSTEM  DESCRIPTION 

The  AN/ALR-56M  and  AN/ALR-74  radar 
warning  receivers  are  designed  to  be  used 
on  the  F-16.  'Die  systems  are  intended  to 
be  effective  in  current  advanced  threat  en¬ 
vironments. 

BACKGROUND 

The  Air  Force  decided  to  compete  the  Ad¬ 
vanced  RWR  after  the  AN/ALR-74  was 
determined  to  be  ineffective  in  operational 
tests.  An  upgraded  AN/ALR-74  and  a 
modified  AN/ALR-56  were  selected  for 
this  competition. 

OT&E  ISSUES 

Operational  test  and  evaluation  issues 
cover  effectiveness  and  suitability  of  the 
RWRs  and  their  ntegration  into  tne  F-16. 


OT&E  ACTIVITY 


Testing  of  the  AN/ALR-56M  and  AN/ 
ALQ-74  began  in  June  1988  on  two 
F-16C  aircraft.  Dynamic  Electromagnetic 
Environment  Simulator  laboratory  testing 
was  completed  in  July  1988  using  three 
operationally  representative  scenarios. 
RF-4C  operational  tests  were  started  in 
September  1988. 

OT&E  ASSESSMENT 


Test  results  are  source-selection  sensitive 
and  were  reported  to  the  Source  Selection 
Evaluation  Board  in  December  1988. 
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B-1B  STRATEGIC  BOMBER 


SYSTEM  DESCRIPTION 

The  B-1B  is  a  strategic  multirole  manned 
bomber  intended  to  deliver  conventional 
and  nuclear  gravity  bombs  as  well  as  to 
serve  as  a  cruise  missile  launch  platform. 
The  primary  role  of  this  aircraft  is  as  a 
strategic  attack  penetrator  which  takes 
maximum  advantage  of  the  combined  ef¬ 
fects  of  low  altitude,  high  speed,  reduced 
radar  cross  section,  high  clutter,  and  elec¬ 
tronic  countermeasures  technology  con¬ 
tributing  to  survivability  in  a  projected 
high  threat  environment  for  this  long- 
range  combat  aircraft. 

BACKGROUND 

The  Defense  System  Acquisition  Review 
Council  (DSARC)  process  was  completed 


for  the  B-1A  in  December  1976,  but  pro¬ 
duction  and  deployment  decisions  were 
subsequently  cancelled  in  June  1977.  In 
July  1980,  Congress  directed  the  Depart¬ 
ment  of  Defense  to  vigorously  pursue  full- 
scale  engineering  development  for  a  multi 
role  bomber  to  achieve  an  initial  opera¬ 
tional  capability  (IOC)  not  later  than 
FY87.  When  the  B-l  program  was  revital¬ 
ized  it  was  “baselined”  to  the  B-1A  and 
took  advantage  of  applicable  B-1A  test 
data.  However,  much  B-1A  design  and 
testing  had  not  been  completed  at  the  time 
of  the  program’s  cancellation.  This  in¬ 
cluded  dynamic  response,  aircraft  struc¬ 
tures  testing,  flying  qualities  at  low  speeds 
and  in  engine-out  conditions,  all-weather/ 
adverse-weather  operations,  diagnostic 
tests,  and  electronic  countermeasures.  In 
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addition,  the  capabilities  of  the  B-1B  were 
expanded  to  include  the  development  of  a 
new  offensive  avionics  system,  expanded 
ECM  coverage,  and  expanded  diagnostics. 
The  B-1B  FSD/production  contract  was 
signed  January  20.  1982,  the  first  flight 
was  on  October  18,  1984,  and  the  first  de¬ 
livery  to  the  Strategic  Air  Command 
(SAC)  was  on  June  29,  1985.  The  Air 
Force  declared  IOC  on  October  1,  1986, 
when  the  first  aircraft  was  placed  on  alert 
status  at  Dyess  AFB,  Texas. 

OT&E  ISSUES 

In  April  1983,  the  B-1B  began  combined 
development  and  initial  operational  test 
and  evaluation  (DT&E/IOT&E).  As  indi¬ 
cated  in  the  current  Test  and  Evaluation 
Master  Flan  (TEMP)  dated  March  1988 
(approved  by  OSD  in  November  1988), 
B-1B  operational  effectiveness  testing  will 
evaluate:  navigation  reliability  and  accu¬ 
racy;  low-level  penetration  capability  util¬ 
izing  terrain  following  radar  and  terrain- 
avoidance  avionics;  survivability  by 
addressing  the  defensive  avionics  system’s 
ability  to  detect,  identify,  and  effectively 
counter  multiple  threats  in  all  sectors;  the 
tail  warning  function’s  (TWF)  ability  to 
detect,  display,  and  provide  expendables 
(chaff/flare)  pulse  for  airborne  intercep¬ 
tors  and  air-to-air  missiles;  and  the  deliv¬ 
ery  of  dissimilar  weapons  on  multiple  tar¬ 
gets.  Operational  suitability  issues  are 
mission  reliability  and  diagnostic  capabil¬ 
ity.  Those  issues  not  satisfied  during  com¬ 
bined  DT&E/IOT&E  will  be  addressed  in 
follow-on  operational  test  and  evaluation 
(FOT&E(l))  within  operational  constraints 
and  limitations. 

OT&E  ACTIVITY 

B-1B  aircraft  #9,  #28,  and  #40  are  the  pri¬ 
mary  aircraft  used  for  combined  DT&E/ 
IOT&E  at  Edwards  AFB,  California.  Ac¬ 
tivities  on  these  aircraft  have  emphasized 
such  critical  operational  features  as  the  of¬ 
fensive  avionics  system  including  auto¬ 


matic  terrain  following,  the  high  resolution 
ground  map  function  of  the  offensive  ra¬ 
dar  system,  and  air  alignment.  B-1B  #1, 
the  first  production  aircraft,  was  delivered 
to  Edwards  AFB  on  October  31,  1984.  It 
flew  138  sorties  to  clear  weapons  delivery 
envelopes,  demonstrate  handling  qualities, 
and  carry  out  offensive/defensive  avionics 
testing.  Throughout  the  flight  program, 
the  IOT&E  test  team  has  taken  an  active 
role  in  mission  development  to  ensure  that 
the  objectives  are  incorporated  and  exe¬ 
cuted  in  as  realistic  an  operational  envi¬ 
ronment  as  possible.  B-1B  #9,  the  first 
B-1B  capable  of  heavyweight,  cruise  mis¬ 
sile,  and  common  strategic  rotary  launcher 
activities,  arrived  at  Edwards  AFB  in 
March  1986.  This  aircraft  has  flown  90 
sorties,  concentrating  on  performance  and 
weapons  testing.  Aircraft  #28  has  flown 
62  sorties,  primarily  to  support  flutter,  vi¬ 
bration,  and  acoustics  testing.  B-1B  #40 
arrived  at  Edwards  on  February  16,  1988, 
to  support  defensive  systems  testing.  Dur¬ 
ing  1988  it  flew  10  sorties.  Suitability  test¬ 
ing  is  being  driven  by  the  IOT&E  test  team 
at  Edwards  AFB,  especially  in  the  areas  of 
technical  order  verification  and  munitions 
handling.  Suitability  data  is  growing  rap¬ 
idly  through  FOT&E(l)  efforts  at  Dyess 
AIB.  FOT&E(l)  allows  the  test  team  to 
determine  “blue-suit”  capability  to  main¬ 
tain  the  B-1B  aircraft  in  an  operational  en¬ 
vironment.  FOT&E  effectiveness  testing 
started  at  IOC  and  is  approximately  50 
percent  complete.  The  164  sorties  flown 
so  far  have  been  used  to  gather  data  on 
terrain  following,  Mod  0  defensive  per¬ 
formance,  weapons  delivery,  navigation, 
radar,  and  cruise  performance.  While 
many  areas  of  operational  effectiveness 
are  progressing  satisfactorily  through 
OT&E,  defensive  systems  testing  is  still 
only  approximately  9  percent  complete. 
Operational  suitability  data  were  gathered 
from  3,458  sorties  (approximately  15,743 
flying  hours)  flown  by  test  team  and  op¬ 
erational  personnel.  Overall,  the  quantita¬ 
tive  portion  of  the  suitability  evaluation  is 
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80  percent  complete,  and  the  qualitative 
portion  is  87  percent  complete.  The  aver¬ 
age  sortie  per  available  aircraft  per  day 
has  steadily  risen  to  0.373  from  0.347  in 
CY  87.  The  desired  operational  require¬ 
ment  is  0.50  at  full  maturity  (200,000  fly¬ 
ing  hours).  Except  for  defensive  testing 
and  portions  of  cruise  missile  testing, 
most  IOT&E  flight  testing  should  be  com¬ 
plete  by  March.  During  1988,  the  DOT&E 
staff  assistant  for  strategic  programs,  an 
experienced  test  pilot,  and  the  Director 
have  individually  flown  operational  B-1B 
test  missions  to  gain  firsthand  knowledge 
of  its  operational  capabilities. 

OT&E  ASSESSMENT 

The  B-1B  is  now  operationally  deployed  at 
four  bases  and  is  fully  integrated  into  the 
Single  Integrated  Operational  Plan.  In  its 
first  head-to-head  competition  with  other 
bombers,  the  B-1B  won  several  key  events 
in  the  SAC’s  annual  bombing  and  naviga¬ 
tion  competition,  Proud  Shield  ’88.  Signifi¬ 
cant  progress  has  been  made  in  the  last 
year  on  the  terrain  following  and  aircraft 
flight  control  systems.  Recent  tests  have 
successfully  demonstrated  automatic 
200-foot  flight  in  the  hard-ride  mode  over 
rugged  mountainous  areas  at  attack 
airspeeds.  Similarly,  the  stall  inhibitor 
system  (SIS  I)  retrofit  is  complete  and  de¬ 
ployed  with  SAC.  However,  a  wide  range 


of  challenges  still  remain  to  be  resolved  in 
order  for  the  B-1B  to  be  a  fully  capable 
weapon  system.  These  problems  include 
aft-bay  SRAM  release,  engine  anti- ice, 
and  an  instrument  landing  system  that  is 
still  not  certified  down  to  published  mini¬ 
mum  approach  weather  because  of  unac¬ 
ceptable  displays  being  presented  to  the 
pilot.  Finally,  major  deficiencies  remain 
in  the  defensive  avionics  suite.  Results 
from  flight  tests  have  revealed  the  AN/ 
ALQ-161  has  design  deficiencies  in  the 
receiver/processor  that  preclude  achieving 
full  operational  capability  without  system 
modification. 

SUMMARY 

The  B-1B  continues  to  make  steady  pro¬ 
gress  towards  meeting  its  operational 
goals  and  is  presently  capable  of  perform¬ 
ing  its  strategic  bomber  mission  better 
than  any  other  aircraft  in  the  Air  Force 
inventory.  However,  the  lack  of  fully  de¬ 
veloped,  operationally  tested  electronic 
warfare  and  tail  warning  function  capabili¬ 
ties  are  significant  deficiencies  that  di¬ 
rectly  affect  the  operational  effectiveness 
of  the  B-1B.  In  order  to  define  B-1B  EW 
and  TWF  capabilities  and  deficiencies  ac¬ 
curately,  this  office  continues  to  stress  the 
importance  of  conducting  OT&E  in  as  op¬ 
erationally  representative  an  environment 
as  possible. 
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SYSTEM  DESCRIPTION 

The  C-5B  is  a  newly  produced  C-5 A 
which  was  introduced  into  the  airlift  sys¬ 
tem  in  January  1986,  and  incorporates 
many  upgraded  subsystems  to  take  advan¬ 
tage  of  technological  advances.  Functional 
performance  of  the  two  aircraft  's  identi¬ 
cal,  although  changes  have  been  made  to 
improve  reliability  and  maintainability, 
while  retaining  maximum  commonality. 
Wiih  few  exceptions,  the  major  compo¬ 
nents  and  systems  incorporated  in  the 
C-5B  are  the  same  as  those  currently  in 
use  on  the  post-wing-mod  C"5*-  *m- 
provements  were  incorporated  2°  COIJe.^ 
oroblems  discovered  in  the  C-5A  since  its 
introduction  into  the  Air  Force  inventory. 
These  changes  include  improved  corrosion 
protection  Ind  hydraulic  subsystems;  up¬ 


graded  avionics,  flight  controls,  and  Mal¬ 
function  Detection,  Analysis,  and 
Recording  System;  and  ^corporation  ^ 
the  latest  engine  configuration.  System 
characteristics  and  performance  are  virtu¬ 
ally  the  same  as  the  C-5A,  with  a  max 
mum  allowable  cabin  load  of  261,000 
pounds,  critical  field  length i  of  10,400  feet, 
and  an  unrefueled  range  of  2,850  nautical 

miles. 

BACKGROUND 

The  November  1980C-X  mission  element 
need  statement  (MENS)  and  the  April 

1981  congressionally  mandated  mobility 

study  (CMMS)  established  the  need  for 
additional  airlift  capability  beyond  what 
was  currently  available.  A  decision  bythe 
Secretary  of  Defense  during  the  83 
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budget  review  placed  increased  emphasis 
on  near-term  improvement  in  intertheater 
airlift  capability  and  directed  funding  for 
50  C-5B  airlift  aircraft.  This  is  a  unique 
program  in  that  it  is  a  sole  source,  firm 
fixed  price  acquisition  of  a  system  that 
had  been  out  of  production  for  a  consider¬ 
able  period  of  time.  The  first  production 
C-5B  was  the  82nd  aircraft  off  the  old 
production  line.  The  production  contract 
was  awarded  in  December  1982,  and  the 
first  C-5B  flight  occurred  in  September 
1985.  The  50tn  aircraft  is  to  be  delivered 
in  March  1989.  Previous  testing  of  the 
C-5B  consisted  of  component  testing,  sub¬ 
system  qualification  test  and  evaluation 
(QT&E),  production  acceptance  test  and 
evaluation  (PAT&E),  and  combined  quali¬ 
fication  operational  test  and  evaluation 
(QOT&E).  Eighty-nine  components  have 
undergone  various  levels  of  qualification 
testing. 

OT&E  ISSUES 

The  objective  of  C-5B  testing,  conducted 
by  the  Military  Airlift  Command  (MAC), 
was  to  refine  estimates  of  operational  ef¬ 
fectiveness  and  suitability,  identify  opera¬ 
tional  deficiencies,  propose  enhancements, 
and  evaluate  system  changes  from  the 
C-5A.  The  primary  operational  issues  for 
this  program  were:  (1)  Will  the  C-5B  per¬ 
form  the  strategic  airlift  mission  equally 
as  well  as  the  C-5A?  (2)  Does  the  C-5B 
meet  the  minimum  requirement  for  sys¬ 
tem-level  reliability,  maintainability  and 
availability?  (3)  Is  the  logistics  support  for 
the  C-5B  adequate  to  meet  mission  needs? 

OT&E  ACTIVITY 

C-5B  follow-on  operational  test  and 
evaluation  (FOT&E),  which  began  March 
15,  1987,  and  ended  March  15,  1988, 
evaluated  operational  effectiveness  and 
suitability.  Primary  emphasis  was  on 
completing  those  objectives  not  completed 
during  QOT&E;  evaluating  changes  and 
modifications  made  to  correct  deficiencies 


noted  during  prior  testing;  and  evaluating 
reliability,  maintainability,  and  availabil¬ 
ity. 

Two  USAF  Airlift  Center  detachments 
were  created,  one  at  Dover  AFB,  Dela¬ 
ware,  and  another  at  Travis  AFB,  Califor¬ 
nia,  to  monitor  the  introduction  of  this 
newly  produced  C-5  into  the  existing  lo¬ 
gistics  and  operational  environment.  Ques¬ 
tionnaires,  interviews,  investigations,  and 
existing  management  reporting  systems 
were  used  to  compare  the  C-5B  to  the 
C-5A.  Testing  of  both  C-5B  and  C-5a 
aircraft  was  accomplished  with  line  as¬ 
signed  crew  members  at  contingency  gross 
weights  of  up  to  840,000  pounds. 

OT&E  ASSESSMENT 

This  office  agrees  with  the  major  conclu¬ 
sion  published  in  the  final  Air  Force 
FOT&E  report  that  the  C-5B  performs  the 
strategic  airlift  mission  better  than  the 
C-5A.  This  system  meets  the  minimum 
requirements  for  system-level  reliability, 
maintainability,  availability,  and  logistics 
support.  In  addition,  the  finding  that  both 
the  C-5A  and  C-5B  can  be  operated  at 
gross  weights  of  up  to  840,000  pounds 
with  operational  aircrews  will  add  flexibil¬ 
ity  to  the  strategic  airlift  mission. 

SUMMARY 

The  C-5B  performed  well  during  the  one- 
year  FOT&E  test  period  (March  1987  to 
March  1988).  Problems  in  some  C-5B 
unique  systems  did  not  deter  the  aircraft 
from  out  performing  its  older  counterpart. 
Continued  attention  is  needed  to  ensure 
that  an  adequate  supply  of  spare  parts  is 
attained.  Operations  above  the  normal 
maximum  gross  weight  of  769,000  pounds 
were  conducted  using  both  C-5A  and 
C-5B  aircraft.  A  contingency  gross  weight 
of  840,000  pounds  will  require  some 
changes  to  technical  data,  but  will  not  re¬ 
quire  any  additional  aircrew  training. 
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F-15  TEWES  UPDATE 


SYSTEM  DESCRIPTION 


The  F-15  TEWES  consists  of  the  AN/ 
AJLQ-135  jammer,  the  AN/ALR-56  radar 
warning  receiver  (RWR),  the  AN/ 
ALQ-128  electronic  warfare  warning  set, 
and  the  AN/ALE-45  countermeasure-  iis- 
penser  set.  The  TEWES  update  ists 
of  major  modifications  to  the  A]  J2- 
135  and  AN/ALR-56  (AN/ALR-50^)  and 
will  be  installed  in  the  F-15D  and  F-15E. 
The  other  two  items  have  been  previously 


1 


tested.  All  elements  of  the  TEWES  are 
internally  mounted  in  the  F-15. 

OT&E  ISSUES 

Operational  test  and  evaluation  issues  for 
wifectiveness  and  suitability  testing  have 
not  yet  been  agreed  upon  by  our  office 
and  the  Air  Force.  Operational  testing  of 
the  AN/ALR-56C  is  expected  to  com¬ 
mence  in  1989.  Delays  in  the  develop¬ 
ment  of  the  AN/AL.Q-135  update  ha1  '  re¬ 
quired  postponing  operational  test'  ;l 
1990. 
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SYSTEM  DESCRIPTION 


The.  F-16  multimission  fighter  is  a  single¬ 
engine,  lightweight,  high  performance  air¬ 
craft,  powered  by  a  25,000-pound  thrust 
class  afterburning  turbofan  engine.  It  is  a 
tactical  fighter  aircraft  with  an  air-to-air 
and  air-to-surface  multirole  capability, 
and  can  be  deployed  with  minimum  en- 
route  support.  The  F-16  has  high  reliabil¬ 
ity  and  simplified  maintenance  procedures 
to  ensure  successful  operations  under  aus¬ 
tere  conditions.  The  F-16  multinational 
staged  improvement  program  (MSIP)  is 
part  of  the  continuing  modernization  of 
US  tactical  fighters  to  reverse  the  upward 
trend  in  higher  total  investment  and  oper¬ 
ating  and  support  costs.  The  F-16  is  em¬ 
ployed  in  a  complementary  role  with  the 


F-15  in  counter-air  missions  and  supple¬ 
ments  the  surface-attack  capabilities  of 
the  F-4,  F-lll,  and  A-10. 

BACKGROUND 

Air  Force  operational  testing  of  the  peri¬ 
odic  MSIP  block  updates  of  the  F-16C/D 
has  been  underway  since  the  combined  de¬ 
velopment  and  initial  operational  test  and 
evaluation  (DT&E/IOT&E)  was  conducted 
from  January  1983  through  December 
1984.  In  addition,  the  Air  Force  Opera¬ 
tional  Test  and  Evaluation  Center 
(AFOTEC)  conducted  independent 
F-16C/D  IOT&E  from  January  to  April 
1985  to  evaluate  F-16  enhancements  re¬ 
sulting  from  the  F-16  MSIP.  The  MSIP 
consists  of  phased  improvements  in  F-16 
air-to-air  and  air-to-surface  mission  ca- 
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pabilities  by  incorporating  new  develop¬ 
ments  in  weapons  and  sensors.  Basic 
changes  in  the  F-16C/D  include  an  im¬ 
proved  radar  (AN/AJPG-68),  improved 
cockpit  displays,  wide-angle  head-up  dis¬ 
play  (HUD),  increased  computer  speed 
and  capacity,  and  provisions  for  future  in¬ 
corporation  of  the  advanced  medium 
range  air-to-air  missile  (AMRAAM),  the 
low  altitude  navigation  and  targeting  infra¬ 
red  for  night  (LANTIRN)  system,  the  air¬ 
borne  self-protection  jammer  (ASPJ),  the 
Global  Positioning  System  (GPS),  and  the 
ALR-74.  The  Tactical  Air  Command 
(TAC)  began  a  follow-on  operational  test 
and  evaluation  (FOT&E)  of  the  F-16C/D 
in  July  1985.  Block  25B  F-16Cs  were 
flown  and  evaluated  from  July  1985  to 
February  1986.  A  subsequent  upgrade  to 
the  Block  25B  operational  flight  programs 
(OFP)  was  the  Block  30,  which  included 
changes  to  the  air-to-air,  air-to-surface, 
and  routine  operation  computations  in  the 
F-16C  avionics  suite.  Testing  of  F-16C/D 
Block  30  OFP  and  some  hardware  changes 
was  done  from  February  to  September 
1986  and  reported  in  our  FY87  Annual 
Report.  After  basic  Block  30  testing,  addi¬ 
tional  upgrades  (Block  30E)  to  the  aircraft 
hardware  and  software  were  incorporated 
to  further  improve  capability,  decrease  pi¬ 
lot  workload,  and  improve  training  poten¬ 
tial.  FOT&E  F-16  Block  30E  operational 
effectiveness  and  suitability  testing  was 
concluded  in  FY88  and  is  briefly  summa¬ 
rized  here. 

OT&E  ISSUES 

The  critical  operational  effectiveness  is¬ 
sues  evaluated  in  F-16  Block  30E  FOT&E 
included  assessing  the  effect  of  MSIP  up¬ 
grade  on  F-16  performance  in  the  opera¬ 
tional  environment,  examining  the  most 
effective  means  of  employing  the  F-16 
Block  30E  in  the  air-to-air  and  air-to-sur- 
face  environments,  identifying  the  tactical 
limitations  on  the  F-16C  Block  30E,  and 
assessing  whether  the  Block  30E  OFP  pro¬ 
vides  the  intended  capability.  Test  limita¬ 


tions  included  munitions,  instrumentation, 
and  range/airspace  availability  at  Luke 
AFB,  Arizona,  which  restricted  available 
scenarios  and  required  test  support  facili¬ 
ties  which  caused  FOT&E  to  be  done  pri¬ 
marily  in  a  desert/mountain  environment. 
There  were  no  AMRAAM  missiles  avail¬ 
able  for  evaluation  with  Block  30E  soft¬ 
ware,  and  the  Block  25B  airframes  used 
F100-PW-200  engines.  In  addition,  op¬ 
erational  effectiveness  testing  included  a 
separate  evaluation  of  the  electronic 
counter-countermeasures  (ECCM)  fea¬ 
tures  of  the  F-16C's  APG-68  radar. 

The  critical  operational  suitability  issue 
was  evaluation  of  the  supportability  of  the 
F-16C  iri  the  field  by  Air  Force  personnel. 
Limitations  to  test  were  the  use  of  interim 
publications  and  preliminary  technical 
data.  Software  documentation  was  not 
available  for  evaluation. 

OT&E  ACTIVITY 

Seven  hundred  and  forty-five  sorties  were 
flown  by  the  57th  Fighter  Weapons  Wing 
at  Luke  AFB  and  Nellis  AFB,  Nevada, 
from  August  1986  to  February  1988  to 
evaluate  operational  effectiveness  of  the 
Block  30E  upgrade  to  the  basic  Block  30 
system.  Deployments  were  flown  to  Nellis 
Are  for  live  ordnance  and  special  weap¬ 
ons  testing  and  to  Eglin  AFB,  Florida,  for 
live  Sidewinder  and  Maverick  missile  fir¬ 
ings  and  electronic  counter-countermea¬ 
sure  testing.  APG-68  radar  ECCM  testing 
was  accomplished  at  Eglin,  Tyndall,  and 
Nellis  Air  Force  Bases  using  91  sorties  by 
the  Tactical  Air  Warfare  Center. 

OT&E  ASSESSMENT 

Testing  showed  that  changes  incorporated 
in  the  Block  30E  OFP  for  routine  opera¬ 
tions  functioned  as  designed.  Changes  for 
programmable  clutter  and  auto  identifica¬ 
tion,  friend  or  foe,  while  mechanically  cor¬ 
rect,  were  difficult  to  use.  Block  30E  im¬ 
provements  enhanced  air-to-air  displays 
and  radar  performance.  Improved  radar 
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performance  greatly  enhanced  pilot  situ¬ 
ation  awareness,  increased  detection 
range,  and  improved  track  retention.  The 
basic  ECCM  capabilities  of  the  AJPG-68 
radar  when  confronted  with  noise  or  de¬ 
ception  jamming  were  identified.  Side¬ 
winder  missile  algorithm  accuracy  ap¬ 
peared  valid. 

Improvements  in  air-to-surface  opera¬ 
tions  were  noted  in  computed  weapons  de¬ 
livery  for  standoff  dive/toss  mode,  maxi¬ 
mum  toss  computations  in  continuously 
computed  reference  point,  no  solution 
mechanization,  and  reversion  to  baromet¬ 
ric  mechanization. 

Block  30E  improvements  in  radar  per¬ 
formance,  cockpit  controls,  and  displays 
reduced  task  complexity  and  increased 
situation  awareness.  Although  Block  30E 
changes  provided  a  potential  for  better 
trained  pilots,  training  feedback  is  de¬ 
graded  with  a  single  video  recorder  on  an 
aircraft  with  multiple  displays  and  com¬ 
plexity. 

Assessments  of  F-16C  availability,  re¬ 
liability,  maintainability,  and  suppor- 
tability  were  based  on  data  gathered  from 
test  assets  as  well  as  compatible  suitability 
data  available  from  other  units  employing 
the  same  aircraft  models.  Test  results 
showed  that  most  F-16C  operational  suit¬ 
ability  thresholds  were  met  or  exceeded. 


Exceptions  were  technical  data  and  quali¬ 
tative  maintainability. 

SUMMARY 

Tne  Block  30E  OFP  on  the  F-16C  pro¬ 
vided  an  overall  improvement  in  capability 
to  accomplish  current  F-16C  missions. 
Significant  improvements  were  noted  in 
air-to-surface,  air-to-air,  and  radar  per¬ 
formance.  Results  of  the  ECCM  testing 
will  be  used  to  correct  deficiencies  in  the 
current  hardware  and  software  of  the 
APG-68  radar.  Air-to-surface  weapons 
employment  with  conventional  ordnance 
was  satisfactory  although  some  problems 
observed  in  previous  testing  still  remain. 
Further  improvements  in  weapon  delivery 
employment  modes  and  accuracy  with 
specific  weapons  are  required.  Degraded 
turning  performance  caused  by  increased 
gross  weight  and  leading  edge  flap  sched¬ 
ule  continue  to  detract  from  operational 
effectiveness. 

Overall  F-16C  operational  suitability  is 
considered  satisfactory  in  most  areas. 
Availability,  reliability,  and  maintainabil¬ 
ity  are  satisfactory.  Qualitative  maintain¬ 
ability  was  satisfactory  except  for  the  un¬ 
availability  of  card  pullers.  Logistics 
supportability  was  satisfactory,  except  for 
marginal  technical  data.  Both  of  these 
problems  should  become  less  significant 
as  the  F-16  support  system  matures. 
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SYSTEM  DESCRIPTION 

The  Joint  Tactical  Information  Distribution 
System  (JTIDS)  is  a  jam-resistant  and  se¬ 
cure  digital  communications  terminal  be¬ 
ing  developed  for  integration  into  various 
weapons  systems  and  facilities  of  each 
Service  and  allied  countries  to  provide 
communications  (data  and  voice),  naviga¬ 
tion,  and  identification  (CNI)  capabilities 
for  joint  and  combined  military  force  op¬ 
erations.  A  JTIDS  configuration  desig¬ 
nated  as  the  Class  1  terminal  has  been  in¬ 
tegrated  into  Air  Force  and  allied  country 
operational  E-3  aircraft.  The  JTIDS  Class 
1  terminal  has  also  been  integrated  into 
the  Air  Force  operational  adaptable  sur¬ 
face  interface  terminal  (ASIT)  shelters  to 


provide  an  interface  between  tactical  air 
control  system  (TACS)  elements  and  the 
joint  tactical  air  operations  (JTAO)  JTIDS 
network  consisting  of  the  E-3A  airborne 
warning  and  control  system  (AWACS), 
F-15  aircraft,  and  Army  air  defense  com¬ 
ponents.  A  smaller  and  higher  capacity 
Class  2  JTIDS  terminal  was  developed  for 
integration  into  F-15  aircraft,  Other-Serv¬ 
ice  key  tactical  platforms,  and  eventual  re¬ 
placement  of  the  Class  1  terminals.  The 
Class  2  terminal  is  bilingual  and  can  proc¬ 
ess  both  the  new  tactical  digital  informa¬ 
tion  link  J  (TADEL  J)  formats  and  the  in¬ 
terim  JTIDS  message  specification  (IJMS) 
messages  used  by  the  JTIDS  Class  1  ter¬ 
minal  to  allow  JTAO  network  inter- 
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operability  and  enhance  mission  effective¬ 
ness. 


JTIDS  communications  are  conducted 
in  a  time-division,  multiple-access 
(TDMA)  protocol  which  permits  operation 
on  a  single  net  or  on  multiple  nets  to  share 
information  in  near  real-time.  JTIDS  in¬ 
formation  is  broadcast  omni-directionally 
at  high  data  rates  and  can  be  received  by 
any  terminal  within  line-of-sight  propaga¬ 
tion  range.  Each  terminal  can  be  set  to 
select  or  reject  each  message  according  to 
its  need  for  that  information.  A  JTIDS 
equipped  platform  can  use  on-board  navi¬ 
gation,  weapons,  and  radar  systems  to 
automatically  feed  status  information  into 
the  integrated  JTIDS  terminal  and  then  to 
a  JTIDS  net.  Information  can  include  tar¬ 
get  data;  JTIDS  platform  position,  veloc¬ 
ity,  and  status;  and  command  messages. 

BACKGROUND 


JTIDS  is  a  major  defense  acquisition  pro¬ 
gram.  The  Air  Force  is  the  lead  Service 
for  the  program,  which  combined  Navy 
and  Air  Force  efforts  from  separate  re¬ 
search  and  development  programs  in  the 
1970s.  The  Air  Force  and  Army  devel¬ 
oped  terminals  with  the  TDMA  architec¬ 
ture.  In  October  1985,  the  Navy  joined 
v  ith  the  Air  Force  to  use  TDMA  modules 
for  integration  into  selected  platforms,  ex¬ 
cluding  the  F/A-18.  Also  in  1985,  the 
Army  initiated  development  of  a  reduced 
size  and  capability  Class  2M  terminal  for 
integration  into  Army  ground  systems. 
The  Army  does  not  plan  to  use  JTIDS  in 
aircraft.  Power  amplifiers  are  being 
added  to  the  Air  Force  Class  2  terminal  to 
create  a  Class  2H  terminal  for  use  in 
TACS  elements  and  for  replacement  of 
the  E-3A  AWACS  Class  1  terminal.  Navy 
E-  2C,  F-14D,  and  ships  will  also  use  a 
power  amplifier  with  the  Class  2.  Plans 
are  now  being  made  to  develop  a  lower 
volume  (LV)  terminal  or  multi-function 


information  distribution  system  (MDDS) 
for  NATO  applications  and  for  smaller  US 
aircraft  (e.g.,  F-16  and  F/A-18). 

An  initial  operational  test  and  evalu¬ 
ation  (IOT&E)  of  JTIDS  Class  2  terminals 
which  were  integrated  into  Air  Force  F-15 
aircraft  and  Army  air  defense  components 
was  conducted  in  FY87.  This  IOT&E  util¬ 
ized  the  Class  1  equipped  E-3A  AWACS 
and  JTIDS  Class  1  ASIT  to  form  a  JTAO 
network  for  testing  purposes.  IOT&E  re¬ 
sults  were  intended  to  provide  information 
for  a  mid-FY87  low-rate  initial  produc¬ 
tion  (LRIP)  decision.  The  LRIP  decision 
has  been  delayed  until  FY89  to  allow  the 
JTIDS  terminal  contractor  time  to  demon¬ 
strate  improvements  in  reliability  and  to 
conduct  additional  field  tests  of  improved 
JTIDS  Class  2  hardware  and  software  with 
improved  aircraft  integration. 

OT&E  ISSUES 


Current  issues  still  concentrate  on  the  ex¬ 
tent  to  which  IOT&E  results  can  confirm 
that  the  items  actually  tested  are  effective 
and  suitable  in  expected  JTAO  combat 
scenarios.  IOT&E  adequacy  was  signifi¬ 
cantly  decreased  by  limitations  in  the 
quantity  and  mobility  of  Army  air  defense 
systems  resulting  from  unsuitable  JTIDS 
Class  2  terminal  reliability.  The  inade¬ 
quate  JTIDS  terminal  reliability  resulted  in 
no  Army  certification  of  readiness  for 
IOT&E  and  a  reduction  in  realism  of 
JTAO  utilization  of  JTIDS  during  the  tests. 
There  were  limitations  inaccurately  por¬ 
traying  the  threat  throughout  the  IOT&E 
including  the  McDonnell  Aircraft  F-15 
manned  air  combat  simulator  facility  and 
at  Eglin  AFB  ranges.  Performance  thresh¬ 
olds  for  message  success  rate  (MSR)  for 
E-3A  AWACS  and/or  ASIT  messages  to 
the  F-15  aircraft  were  evolved  over  the 
IOT&E  period;  one  of  the  two  was  not  al¬ 
ways  available  to  the  F-15;  and  the  mini¬ 
mum  standard  for  an  individual  E-3A  or 
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ASIT  link  was  reduced  from  80  to  50  per¬ 
cent  MSR. 


The  multi-Service  test  and  evaluation 
master  plan  (TEMP)  and  IOT&E  plans 
were  not  fully  approved  by  OSD.  Efforts 
are  continuing  to  obtain  Air  Force  submit¬ 
tal  of  a  multi-Service  TEMP  which  in¬ 
cludes  multi-Service  operational  field  sys¬ 
tem  test  data  to  validate  manned 
simulations  and  to  confirm  JTIDS  opera¬ 
tional  effectiveness  during  JTAO  scenarios 
each  with  realistic  mission  scenario  repre¬ 
sentations.  Improvements  are  required  in 
the  August  26,  1988  draft  TEMP  to  in¬ 
clude  additional  tests  before  the  planned 
June  1989  Defense  Acquisition  Board 
(DAB)  decision  on  low-rate  initial  produc¬ 
tion  (LRIP). 


OT&E  ACTIVITY 


A  multi-Service  test  team  conducted 
IOT&E  of  the  JTIDS  Class  2  system  from 
August  12,  1986,  through  April  17,  1987. 
The  Air  Force  operational  Test  and  Evalu¬ 
ation  Center  (AFOTEC)  was  the  lead 
agency  for  IOT&E  activities.  Testing  was 
conducted  in  three  phases  at  three  loca¬ 
tions.  The  first  phase  was  conducted  from 
August  12  to  September  25,  1986,  at  the 
McDonnell  Aircraft  F-15  manned  air  com¬ 
bat  simulator  facility  in  St.  Louis,  Mis¬ 
souri,  where  243  simulator  engagements 
were  conducted.  The  F-15  flight  test 
phase  was  conducted  at  both  the  Tyndall 
AFB  and  Eglin  AFB  ranges  in  Florida 
from  December  2,  1986,  to  April  17, 
1987,  with  56  flight  engagements  during 
Air  Force  target  efficiency  tests.  The  third 
phase  of  testing  was  conducted  from  Feb¬ 
ruary  23  to  April  17,  1987,  at  Eglin  AFB, 
where  the  Air  Force  made  25  flight  en¬ 
gagements  during  multi-Service  testing. 
The  JTIDS  ASIT  follow-on  operational 
test  and  evaluation  (FOT&E)  was  con¬ 
ducted  at  Duke  and  Hurlburt  Fields,  Flor¬ 
ida,  from  November  1986  to  April  1987 


and  provided  the  TACS  interface  during 
Class  2  IOT&E  flight  testing  phases. 

Other  modeling,  simulation,  and  analy¬ 
ses  have  been  conducted  to  support  or  po¬ 
tentially  supplement  results  from  field 
testing.  This  includes  link  connectivity 
analyses  with  the  TAC  JAMIT  model, 
data-link  vulnerability  analyses  (DVAL), 
and  modeling  by  Teledyne  Brown  Engi¬ 
neering.  Test  support  was  also  performed 
by  the  MITRE  Corporation  and  the  Joint 
Electronic  Warfare  Center  (JEWC). 
AFOTEC  is  preparing  a  report  of  addi¬ 
tional  conclusions  and  analyses  of  IOT&E 
data  to  support  planning  of  future  testing 
to  resolve  open  issues  concerning  jamming 
resistance  and  ground-to-ground  propaga¬ 
tion. 

The  JTIDS  Class  2  terminal  contractor 
announced  in  August  1988  that  the  Class  2 
terminal  had  been  improved  in  reliability 
through  laboratory  testing  to  over  300 
hours  MTBF  as  compared  to  approxi¬ 
mately  50  hours  laboratory  MTBF  prior  to 
the  IOT&E.  Testing  in  F-15  aircraft  is 
planned  for  January  1989. 

OT&E  ASSESSMENT 

IOT&E  testing,  although  limited,  was  ade¬ 
quate  to  determine  that  the  F-  15’s  defen¬ 
sive  counter-air  (DCA)  mission  was  en¬ 
hanced  in  a  benign  Air  Force-only  DCA 
environment.  F-15  target  efficiency  flight 
test  results  indicated  that  JTIDS  contrib¬ 
uted  to  reducing  the  proportion  of  hostile 
bombers  reaching  their  targets  from  72  to 
57  percent  and  increased  the  proportion  of 
hostiles  targeted  by  F-15s  from  45  to  55 
percent.  Tliese  flight  test  results  are  not 
claimed  to  be  statistically  significant,  but 
do  include  the  realism  of  live  systems  ver¬ 
sus  the  McDonnell  Aircraft  digital  simula¬ 
tion.  Improved  situation  awareness  and 
mutual  support  were  cited  by  the  F-15  test 
pilots  as  the  major  contributors  to  JTEDS- 
equipped  DCA  mission  effectiveness. 
This  situation  awareness  increased  the  ca¬ 
pability  to  determine  hostile  formation  ge- 
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ometry.  More  F-15s  were  also  engaged 
by  hostile  fighters  during  flight  tests,  re¬ 
ducing  F-15  survivability  as  compared  to 
simulation,  which  had  perfect  but  unrealis¬ 
tic  net  tracking  of  hostiles.  Flight  tests  at 
Tyndall  AFB  resulted  in  an  increase  in  the 
fraction  of  F~15s  targeted  by  hostiles  from 
10  percent  without  JTIDS  to  24  percent 
targeted  when  using  JITDS.  The  McDon¬ 
nell  Aircraft  simulation  indicated  that  us¬ 
ing  JTDDS  reduced  the  fraction  of  F-15s 
targeted  by  hostiles  from  45  to  23  percent. 
Results  have  not  been  sufficient,  and  addi¬ 
tional  data  is  likely  to  be  required  to  con¬ 
clusively  confirm  F-15  operational  effec¬ 
tiveness  in  DIA  validated  jamming  threat 
scenarios  and  multi-Service  JTAO  mis¬ 
sions.  Further,  the  Air  Force  require¬ 
ments  for  message  success  rate  on  key 
links  were  evolved  over  the  IOT&E  period 
and  require  additional  Service  review  to 
establish  appropriate  requirements  for  all 
platforms.  Some  system-level  issues  were 
raised  but  not  resolved  by  IOT&E  results 
concerning  use  of  relays,  net  capacity  and 
management  voice  techniques  and  inter¬ 
operable  voice  networks,  and  track  corre¬ 
lation  accuracy.  For  example,  the  known 
track  inaccuracies  of  the  E-3A  and  CRC 
were  automatically  distributed  on  the 
JTIDS  net  and  displayed  on  the  F-15  and 
other  JTIDS  displays  without  any  indica¬ 
tion  of  the  inaccuracy  to  the  viewer. 


Testing,  although  limited,  was  ade¬ 
quate  to  determine  that  JTIDS  perform¬ 
ance  in  Army  ground  air  defense  missions 
was  neither  effective  nor  suitable.  Per¬ 
formance  was  unsatisfactory  for  Army 
ground  systems  and  was  marginal  to  un¬ 
satisfactory  for  similarly  affected  ASIT 
systems  during  tests  at  Eglin  AFB.  The 
Army  operations  also  identified  funda¬ 
mental  problems  with  JTIDS  ground-to- 
ground  links  due  to  signal  propagation 
during  the  multi-Service  phase  or  testing. 
It  became  clear  that,  in  a  European  envi¬ 
ronment,  Army  forward  links  may  be  re¬ 
duced  and  much  taller  antenna  masts  and/ 


or  additional  relays  would  be  required  to 
establish  links.  ASIT  Class  1  operations 
also  identified  ground-to-ground  link 
problems.  These  problems  raised  ques¬ 
tions  concerning  JITDS  operational  effec¬ 
tiveness  as  a  dedicated  ground-to-ground 
data  distribution  medium  for  the  Army. 
As  a  result,  earlier  decisions  by  Army  doc¬ 
trinal  and  material  developers  are  still  be¬ 
ing  reevaluated  to  determine  further  direc¬ 
tion.  The  AFOTEC  ASIT  FOT&E  report 
also  recommended  additional  testing, 
which  has  not  been  completed,  to  deter¬ 
mine  key  link  availability. 

As  expected  from  development  testing 
prior  to  IOT&E,  JTIDS  terminal  reliability 
and  maintainability  performance  was  not 
operationally  suitable  and  has  received  the 
most  attention  since  completion  of  IOT&E 
at  Eglin  AFB.  These  deficiencies  were  de¬ 
tected  during  development  tests  at  Eglin 
and  contributed  to  a  reduction  of  IOT&E 
realism  and  Army  participation  in  the  op¬ 
erational  tests.  IOT&E  mean  time  be¬ 
tween  critical  failure  (MTBCF)  was  found 
to  be  approximately  20  hours  as  compared 
to  the  requirement  of  120  hours.  The 
mean  time  between  maintenance  was 
found  to  be  approximately  7  hours  as 
compared  to  the  requirement  of  115 
hours.  The  built-in-test  was  able  to  de¬ 
tect  only  64  of  159  failures  and  was  able 
to  isolate  faults  to  a  line  replaceable  unit 
only  55  of  159  times.  Contractor  labora¬ 
tory  testing  since  IOT&E  has  improved  the 
laboratory  demonstrated  hardware  reliabil¬ 
ity  to  over  300  hours  MTBF  as  of  August 
1988. 

SUMMARY 

Limited  operational  test  and  evaluation  or 
analysis  of  additional  reports  and  data 
may  be  necessary  to  clarify  system  per¬ 
formance,  operational  implications  of 
ground-to-ground  propagation,  and  key 
link  MSR  requirement  variations  prior  to  a 
low-rate  initial  production  (LRIP)  deci¬ 
sion.  AFOTEC  is  preparing  an  additional 
report  and  data  from  experiments  and 
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analyses  of  Class  2  IOT&E  data.  DOT&E 
is  still  reviewing  these  issues  with  the 
Services  and  other  OSD  offices  in  prepa¬ 
ration  for  testing  planned  to  begin  in  Janu¬ 
ary  1989  and  for  the  DAB  planned  in  June 
1989.  Additional  multi-Service  opera¬ 


tional  test  and  evaluation  will  definitely  be 
required  to  confirm  system  performance 
prior  to  a  JTIDS  full-rate  production  deci¬ 
sion.  DOT&E  approval  of  the  TEMP  will 
document  these  agreements. 
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LOW  ALTITUDE  NAVIGATION  AND  TARGETING  INFRARED  FOR 

NIGHT  SYSTEM  (LANTIRN) 


SYSTEM  DESCRIPTION 

The  LANTIRN  system  is  being  developed 
to  fulfill  the  need  for  a  night  attack  capa¬ 
bility  in  the  close  air  support,  battlefield 
interdiction,  offensive  counter-air,  and  air 
interdiction  mission  areas.  The  system  is 
designed  for  use  on  F-16C/D  and  F-15E 
aircraft  and  consists  of  a  wide  field— of— 
view  (WFOV)  head-up  display  (HUD),  a 
navigation  (NAV)  pod,  and  a  targeting 
pod.  The  head-up  display  is  an  electro- 
optical  device  which  computes  flight,  navi¬ 
gation,  and  weapon-delivery  information 
and  displays  it  in  the  pilot’s  line  of  sight. 
The  NAV  pod  contains  a  forward-looking 
infrared  receiver  (FUR),  a  terrain-avoid¬ 
ance  radar,  and  subsystems  for  servo-con¬ 


trol.  The  targeting  pod  functions  include 
FUR  imaging,  laser  designation,  precision 
pointing  and  tracking,  and  missile 
boresight  correlation  for  AGM-65D  Mav¬ 
erick  missile  handoff  and  lock-on. 

BACKGROUND 

Combined  development  test  and  evalu¬ 
ation/initial  operational  test  and  evaluation 
(DT&E/IOT&E)  of  the  LANTIRN  system 
began  in  July  1983.  The  LANTIRN  pro¬ 
gram  was  restructured  in  August  1984  as  a 
result  of  lagging  target  pod  development, 
budget  constraints,  and  unavailability  of 
F-16  test-bed  aircraft. 

After  program  restructuring,  IOT&E  of 
LANTIRN  began  in  October  1984  and  was 
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completed  in  two  phases,  which  ended  in 
April  1986.  IOT&E  test  results  supported 
a  full-production  decision  for  the  NAV 
pod,  while  FOT&E  was  planned  to  evalu¬ 
ate  corrections  to  targeting  pod  deficien¬ 
cies  before  making  a  Full-production  deci¬ 
sion  for  that  LANilkN  component.  The 
DOT&E  beyond  low-rate  initial  production 
report  to  the  Congress  and  the  Secretary 
of  Defense  (November  14,  1986)  ad¬ 
dressed  the  adequacy  and  results  of  the 
IOT&E  of  the  NAV  pod.  Our  FY86  An¬ 
nual  Report  covered  the  results  of  the 
IOT&E  of  the  complete  LANTERN  system. 

In  FY87  the  Air  Force  conducted  Fol¬ 
low-on  Operational  Test  and  Evaluation, 
Phase  One  (FOT&E(l))  from  February  to 
July  1987.  This  focused  on  the  LANTiRN 
targeting  pod.  Of  the  seven  effectiveness 
objectives  addressed  in  IOT&E  and 
FOT&E(l),  DOT&E  considered  two  to  be 
satisfactory  in  this  last  phase  of  opera¬ 
tional  testing — Maverick  missile  delivery 
capability  and  LANTIRN  controls  and  dis¬ 
plays.  Laser-guided  bomb  (LGB)  delivery 
capability  was  considered  to  be  marginal. 
Unguided  weapon  delivery  testing  was  in¬ 
complete,  although  the  single  tested  un¬ 
guided  mode  of  conventional  delivery 
showed  satisfactory  results.  Navigation 
capability  with  LANTiRN,  survivability, 
and  EOCM  vulnerability  had  been  judged 
satisfactory  in  previous  testing.  The  capa¬ 
bility  to  integrate  the  LANTIRN  navigation 
pod  into  the  tactical  air  forces  was  evalu¬ 
ated,  and  F-16  pilot  workload  was  satis¬ 
factory  for  the  LANTIRN  navigation  and 
terrain  following  tasks.  Integration  of  the 
targeting  pod  was  not  addressed  in 
FOT&E(  1 ),  although  pilots  using  the  com¬ 
plete  LANTIRN  system  will  require  high 
levels  of  training  to  maintain  proficiency 
with  the  targeting  pod.  Fighter  squadrons 
using  LANTIRN  will  require  increased 
support  in  some  areas  such  as  weather 
and  intelligence. 

The  operational  suitability  evaluation 
of  the  entire  LANTIRN  system  was  ad¬ 


dressed  by  five  objectives  in  FOT&E(l). 
DOT&E  considered  logistics  support  reli¬ 
ability,  mission  performance  reliability, 
and  availability  to  be  satisfactory.  We 
rated  overall  system  maintainability  mar¬ 
ginal  -  primarily  because  of  targeting  pod 
nose/roll  section  alignment  times,  coolanol 
leaks,  water  intrusion,  and  built-in  test 
(BIT)  mechanization.  Contractor  mainte¬ 
nance  was  used  throughout  the  test,  and 
estimates  of  Air  Force  capability  were 
made  using  over-the-shoufder  observa¬ 
tions.  As  in  previous  testing,  the  logistics 
supportability  evaluation  was  incomplete 
because  integrated  logistics  support  ele¬ 
ments  were  not  available  during  the  test. 

Our  FY87  Annual  Report  discussed  the 
results  of  the  FOT&E(l)  of  the  complete 
LANTIRN  system.  Based  on  FOT&E(l) 
test  results  and  the  Director’s  concerns 
about  test  limitations,  the  Air  Force  re¬ 
scheduled  the  full-rate  production  deci¬ 
sion  for  the  targeting  pod  to  October  1988. 
The  Air  Force  continued  low-rate  produc¬ 
tion  for  the  targeting  pod,  but  did  not 
change  FY87  planned  production  quanti¬ 
ties.  In  October  1988,  due  to  problems 
with  the  laser  in  the  production  targeting 
pod,  the  Air  Force  again  continued  low- 
rate  production  at  the  FY87  quantity.  The 
Air  Force  decided  to  enter  full-rate  pro¬ 
duction  and  briefed  the  Director  on  test 
progress,  after  the  laser  problem  was 
solved  in  December  1988  A  Beyond 
Low-Rate  Initial  Production  Report  on  the 
targeting  pod  was  submitted  to  the  Con¬ 
gress  on  December  28,  1988. 

OT&E  ISSUES 

At  the  conclusion  of  FOT&E(l),  the  Direc¬ 
tor,  Operational  Test  and  Evaluation,  and 
Air  Force  officials  agreed  to  18  decision 
criteria  to  be  used  to  assess  the  progress 
of  LANTIRN  testing  and  correction  of  de¬ 
ficiencies  and  test  limitations  identified  in 
FOT&E(l).  Nine  of  the  18  were  con¬ 
cerned  with  reliability  and  maintainability 
issues,  and  nine  focused  on  aircraft  inte¬ 
gration  and  weapon  delivery  capability. 
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The  reliability  issues  addressed  laser  reli¬ 
ability  design,  improved  quick  discon¬ 
nects,  improved  slip  rings,  water  intrusion, 
production  design  coolers,  targeting  pod/ 
intermediate  support  equipment,  built-in¬ 
test  fault  reporting,  targeting  pod  main¬ 
tainability  verification  testing,  and 
targeting  pod  maintainability  improve¬ 
ments.  Four  criteria  were  focused  on  dem¬ 
onstrating  production  navigation  and  tar¬ 
geting  pods  on  production  F-16  Block  40 
and  F-15E  aircraft.  Weapon  delivery  crite¬ 
ria  involved  improved  LGB  delivery  capa¬ 
bility,  demonstration  of  the  wide  field— of— 
view  on  the  targeting  pod,  F-16/ 
navigation  pod  weapon  delivery,  F-l  6/tar¬ 
geting  pod  weapon  delivery,  and  F-15E/ 
LANTlKN  weapon  delivery. 


Assessment  of  LANTlKN  suitability 
has  been  an  OT&E  issue  because  of  con¬ 
tractor  maintenance  on  the  LANTIRN  sys¬ 
tem.  Contractor  maintenance  in  the  initial 
stages  of  LANTlKN  deployment  has  been 
the  Air  Force  concept  for  LANTIRN  main¬ 
tenance  since  its  development.  At  the  di¬ 
rection  of  the  DOT&E,  the  Air  Force  will 
conduct  an  evaluation  of  “blue-suit” 
maintenance  capability  with  the  LANTIRN 
system  when  production  equipment,  sup¬ 
port  equipment,  and  trained  Air  Force 
personnel  are  available  in  FY89.  In  the 
interim,  the  Air  Force  has  certified  that 
contractor  maintenance  and  support  for 
the  LANTIRN  system  will  be  contracted 


for  at  a  level  equivalent  to  that  used  dur¬ 
ing  IOT&E. 

OT&E  ACTIVITY 

There  was  no  formal  scheduled  phase  of 
operational  testing  for  LANTIRN  in  FY88. 
Developmental  testing  continued  and  op¬ 
erational  test  pilots  flew  test  and  training 
sorties  with  upgraded  FSD  LANTIRN  pods 
to  maintain  currency  with  LANTIRN  and 
prepare  for  upcoming  IOT&E  on  the 
F-15E  and  F-16  Block  40.  Both  of  these 
IOT&Es  will  use  the  production  LANTIRN 
system.  DOT&E  staff  members  monitored 
suitability  improvements  and  integration/ 
weapon  delivery  progress  as  outlined  in 
the  decision  criteria  agreement.  The  Di¬ 
rector  flew  LANTlKN  sorties  in  both  the 
F-15E  and  the  F-16. 

SUMMARY 

The  LANTIRN  system  provides  a  night, 
single-seat,  low-altitude  operational  capa¬ 
bility  that  does  not  currently  exist  in  the 
tactical  air  forces.  In  FY87  FOT&E(l) 
identified  deficiencies  that  required  cor¬ 
rection  and  test  limitations  that  needed  to 
be  overcome  before  the  Director  would 
support  full  production  of  the  targeting 
pod.  FY88  testing  made  considerable  pro¬ 
gress  in  both  these  areas  and,  in  early 
FY89,  LANTlKN  testing  was  adequate  to 
satisfy  the  18  decision  criteria  and  support 
a  full-rate  decision  for  the  targeting  pod. 
A  B-LRIP  Report  on  the  Targeting  Pod 
was  submitted  to  the  Congress  on  28  De¬ 
cember  1988. 
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SYSTEM  DESCRIPTION 


Milstar  is  designed  to  extend  our  present 
military  satellite  communications  (MIL- 
SATCOM)  capabilities  by  emphasizing 
jamming  resistance,  survivability,  and 
global  connectivity  for  strategic  and  tacti¬ 
cal  users,  the  intelligence  community,  and 
secure  transmission.  It  will  provide  global 
communications  through  a  constellation  of 
geosynchronous  satellites  at  high  and  low 
inclination  orbits.  This  constellation  will 
service  networks  employing  approximately 
1900  relatively  small  and  mobile  terminals 
for  use  on  land,  sea,  and  air  platforms. 
The  system  operates  at  44  and  20  GHz, 
the  highest  frequencies  used  in  our  pre¬ 
sent  NuLSATCOM  systems.  (The  Defense 
Satellite  Communications  System  operates 


at  approximately  8  GHz).  Milstar  incor¬ 
porates  frequency  hopping,  interleaving 
(to  reduce  scintillation  effects  from  atmos¬ 
pheric  nuclear  bursts),  and  the  prolifera¬ 
tion  of  its  decentralized  satellite  constella¬ 
tion  control  stations  to  enhance  its 
survivability  features.  Existing  user  equip¬ 
ment  from  all  services  (e.g.,  teletypes, 
digital  voice  terminals,  and  facsimiles)  can 
connect  directly  to  the  automated  Milstar 
terminals  to  provide  ’’transparent"  links 
between  users. 

BACKGROUND 

Present  MILSATCOM  systems  are  not  de¬ 
signed  to  survive  a  nuclear  detonation  en¬ 
vironment  and  are  susceptible  to  jamming 
and  antisatellite  (AS AT)  interceptors. 
Milstar  is  designed  to  survive  significantly 


MILSTAR 


V-43 


AIR  FORCE 


higher  levels  of  these  threats  and  to  con¬ 
tinue  to  provide  minimum  essential  global 
communications  for  periods  of  many 
months  following  the  initial  exchanges  in  a 
nuclear  scenario.  The  Air  Force  has  lead 
Service  development  and  OT&E  responsi¬ 
bility,  and  all  three  Services  are  develop¬ 
ing  terminals  for  their  respective  plat¬ 
forms.  Initial  production  decisions  for  two 
of  the  three  segments,  space  and  mission 
control,  were  made  in  November  1984. 
The  third  segment,  terminals,  is  in  full- 
scale  development,  with  initial  production 
decisions  scheduled  for  1989.  The  first 
full-scale  Milstar  production  satellite  is 
scheduled  for  launch  in  the  early  1990s. 
A  surrogate  Milstar  payload  with  limited 
capability  was  placed  into  orbit  on  a 
FLTSATCOM  satellite  in  late  1986  and  is 
now  being  employed  successfully  for  de¬ 
velopment  and  operational  testing  of  the 
terminals. 

OT&E  ISSUES 

The  major  Milstar  OT&E  issues  are: 
(1)  communications  resource  manage¬ 
ment,  (2)  constellation  control,  (3)  system 
survivability,  (4)  communications  connec¬ 
tivity,  and  (5)  operational  suitability.  Spe¬ 
cific  issues  resulting  from  the  generally 
successful  OT&E-pertinent  activity  in 
FY88  include: 

o  Multi-Service  OT&E  planning 
and  the  integrated  analysis  of  the  results. 
The  Air  Force,  as  lead  Service,  must  im¬ 
prove  the  coordinated  planning  of  system 
OT&E  pertinent  events  occurring  prior  to 
the  first  Milstar  launch  in  the  early  1990s 
and  the  timely  analysis  (from  a  systems 
perspective)  of  pertinent  data  as  it  be¬ 
comes  available.  Examples  include  up¬ 
dates  to  the  validated  requirements  and 
the  operational  concepts,  the  preparation 
of  an  integrated  system  survivability 
OT&E  plan,  the  preparation  of  representa¬ 
tive  network  management  protocols  to 
support  OT&E,  the  analysis  of  existing 
data  to  determine  operational  limitations 


due  to  rain  at  low  satellite  elevation  an¬ 
gles,  and  the  preparation  of  system  early 
operational  assessments. 

o  Terminal  maintainability.  This 
problem  was  the  most  prominent  issue  re¬ 
vealed  in  the  initial  Navy  terminal  OT&E. 
It  includes  the  viability  of  the  built-in  test 
concept. 

OT&E  ACTIVITY 

Initial  OT&E  of  the  Navy  Milstar  terminal 
was  conducted  in  March-May  1988.  The 
results  demonstrated  potential  operational 
effectiveness  and  suitability,  and  defined 
areas  for  further  development  effort.  A 
successful  demonstration  of  all  three  Serv¬ 
ices’  terminals  interoperability  and  com¬ 
patibility  with  the  orbiting  FLTSAT- 
COMEHF  Package  (FEP)  was  conducted 
in  July  1988.  Simulated  operational  mes¬ 
sages  were  sent  over  voice  and  teletype 
channels.  During  1988,  terminals  oper¬ 
ated  successfully  with  FEP  from  ship,  sub¬ 
marine,  aircraft,  and  ground  platforms. 
All  three  terminals  have  operated  with  a 
ground-based  breadboard  Milstar  pay- 
load. 

OT&E  ASSESSMENT 

OT&E  activities  conducted  in  FY88  (in¬ 
volving  the  terminals  of  all  three  Services 
and  the  breadboard  satellite  payload)  pro¬ 
vide  strong  evidence  the  Milstar  system 
will  eventually  become  operationally  effec¬ 
tive  and  suitable.  The  test  activity  re¬ 
vealed  the  need  for  Navy  terminal  main¬ 
tainability  improvement.  The  Navy  is 
currently  making  a  concerted  effort  to  re¬ 
solve  this  issue.  Little  information  perti¬ 
nent  to  OT&E  is  available  for  the  space 
and  mission  control  segments,  which  are 
scheduled  for  integration  and  test  in  FY89. 

SUMMARY 

A  substantial  number  of  OT&E  activities 
conducted  in  FY88  yielded  encouraging 
results  and  thus  indicate  no  major  obsta* 
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cles  to  the  eventual  operational  effective¬ 
ness  and  suitability  of  the  Milstar  system. 
The  results  provided  evidence  for  the  suc¬ 
cessful  resolution  of  a  major  system  re¬ 
quirement:  terminal  interoperabil-ity  and 
compatibility  with  the  satellite  payload. 


However,  before  overall  system  opera¬ 
tional  effectiveness  and  suitability  can  be 
validated,  considerably  more  OT&E  re¬ 
mains  to  be  accomplished,  particularly  in 
the  space  and  mission  control  segments. 
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SYSTEM  DESCRIPTION 

The  over-the-horizon  backscatter  radar 
(OTH-B)  provides  long-range  detection, 
tracking,  and  correlation  of  airborne  tar¬ 
gets.  The  system  consists  of  separate 
transmit  and  receive  antennas  and  a  con¬ 
trol  system. 


BACKGROUND 

The  current  OTH-B  has  been  under  devel¬ 
opment  since  feasibility  demonstrations  of 
an  East  Coast  system  m  1981.  Individual 
sectors  of  the  system  have  been  operated 
by  TAC  personnel  since  1987.  Difficulties 
in  integrating  sectors  have  precluded  op¬ 
erational  tests.  Final  developmental  tests 
are  scheduled  to  begin  in  early  1989  and 
operational  testing  may  begin  in  1989. 
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I'he  Peacekeeper  missile  is  a  three stage 
ICBM  designed  to  deliver  up  to  p:  MK  .’.I 
multiple  independently  targeted  reentrv 
vehicles  (MIRVs).  The  missile  is  approxi¬ 
mately  7 1  feet  lone  and  92  inches  in  di¬ 
ameter.  and  weighs  about  l'T\0f)0  pounds. 
Peacekeeper  is  the  first  P'S  ICBM  to  use  a 
eoki  launch  exit  from  its  launcher  The 
first  three  stapes  use  solid  propellants, 
achieving  thrust-vector  deflection  with  sin¬ 
gle  stage  movable  nozzles  The  second 
and  third  stage  nozzles  use  specially  de¬ 
signed  extendible  exit  cones  The  three 
boost  stages  produce  most  of  the  vclocitv 
needed  for  inter .  outmental  range  The  liq¬ 
uid  fueled  posi  ooost  vehicle  provides  am 
needed  vclocitv  and  dfotude  corrections 


ptior  to  release  of  the  Mk-dl  MIRX's 
The  missile  is  being  deployed  in  modified 
Mmuteman  launch  facilities  containing  op¬ 
erational  support  equipment  to  provide 
communication  and  launch  functions.  Op¬ 
erational  control  is  exercised  through  Stra¬ 
tegic  Air  Command  (SAC)  personnel  m 
hardened  Mmuteman  launch  control  cen¬ 
ters  or  airborne  launch  control  centers. 
This  missile  represents  an  improvement 
over  previous  ICBMs,  being  able  to  deliver 
more  MIRX's  per  missile  over  a  target 
footprint  and  with  bcUer  accuracv. 

BACKCROi  NI) 

l  ull  >calc  development  of  this  mtci  conti¬ 
nental  missile  was  initiated  in  1C7P  A 
lout -phase.  Jn  launch  test  program  was 
planned  I  he  combined  development  and 
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operational  test  and  evaluation  (DT&E/ 
OT&E)  commenced  in  September  1982, 
with  ground  activities  at  Vandenberg  AFB, 
California,  using  an  inert  missile  to  verify 
compatibility  or  facility  and  procedures 
prior  to  assembly  and  launch  of  the  first 
flight  missile  in  June  1983.  Phase  I  of  the 
missile-launch  program  ended  with  the 
successful  launch  of  the  fifth  Peacekeeper 
on  June  15,  1984.  The  second  phase  of 
testing  was  completed  with  the  successful 
thirteenth  launch  on  August  23,  1986. 
Phase  DI  ended  successfully  with  the  six¬ 
teenth  launch  on  February  13,  1987.  The 
last  phase  of  flight  testing  (operational 
system  verification)  will  be  completed  with 
the  final  three  flights.  This  phase  will  fur¬ 
ther  verify  operational  procedures  and  any 
configuration  block  changes. 

OT&E  ISSUES 

Combined  DT&E/OT&E  is  investigating 
the  following  issues  as  identified  in  the 
Peacekeeper  in  Minuteman  Silos  Test  and 
Evaluation  Master  Plan  (TEMP),  approved 
by  OSD  in  April  1987:  (1)  mission  effec¬ 
tiveness,  which  addresses  targeting  effi¬ 
ciency,  alert  availability,  and  weapon  sys¬ 
tem  reliability;  (2)  probability  of  damage, 
which  addresses  weapon  system  accuracy, 
weapon  yield,  and  target  hardness;  (3) 
survivability,  which  addresses  capabilities 
of  the  hardware  to  perform  critical  func¬ 
tions  after  being  subjected  to  nuclear 
weapon  effects;  (4)  weapon  system  inte¬ 
gration,  which  addresses  and  verifies  in¬ 
teroperability  of  new  and  existing  systems, 
support  equipment,  and  facilities;  and  (5) 
weapon  system  operation  and  support, 
which  encompasses  logistics  reliability, 
maintainability,  support  equipment,  trans¬ 
portation  and  handling,  technical  data, 
supply  support,  and  manpower  and  train¬ 
ing. 

Two  primary  system-level  measures  of 
effectiveness  are  used  to  quantitatively 
measure  the  degree  to  which  the  system 
performs  its  operational  task.  The  first, 


the  Mission  Effectiveness  Factor  (MEF), 
projects  on  a  total  force  level  the  percent¬ 
age  of  deployed  warheads  that  would  pro¬ 
duce  a  nuclear  detonation  in  their  planned 
target  areas  during  wartime  execution. 
The  second,  Probability  of  Damage  (Pd), 
expresses  the  probability  that  the  resulting 
nuclear  detonation  would  inflict  damage 
on  the  intended  targets.  These  are  ex¬ 
pressed  as  follows: 

MEF  Targeting  Efficiency  x  Alert  Avail¬ 
ability  x  Weapon  System  Reliability.  Pd  is 
a  function  of  weapon  system  accuracy, 
warhead  yield,  and  target  hardness. 

From  the  above  relationships,  weapon 
system  reliability  and  accuracy  are  directly 
testable  and  are  products  of  the  combined 
DT&E/OT&E  program.  Warhead  yield 
and  target  hardness  are  provided,  respec¬ 
tively,  by  the  Department  of  Energy  and 
SAC.  The  remaining  areas  (survivability, 
weapon  system  integration,  and  system 
operation  and  support)  are  being  ad¬ 
dressed  by  qualitative  assessments. 

OT&E  ACTIVITY 

Seventeen  of  20  planned  test  flights  have 
been  completed  at  the  Western  Test  Range 
at  Vandenberg  AFB,  California.  The  op¬ 
erational  system  verification  phase  (Phase 
IV)  of  the  flight  test  program  is  continu¬ 
ing. 

Several  significant  test  events  of  the 
Common  Airborne  Launch  Control  Center 
(CALCC)  were  conducted  January-May 
1988.  In  January,  extensive  evaluation  of 
new  CALCC  software  successfully  demon¬ 
strated  Minuteman/Peacekeeper  transmit 
and  process  commands.  In  addition,  mis¬ 
sile  status  was  correctly  received  and  proc¬ 
essed  by  an  uplink  to  the  CALCC.  An 
Emergency  Rocket  Communication  Sys¬ 
tem  test  sequence  demonstrated  good 
range  capability  for  the  newly  modified 
Pacer  Link  radio  systems.  In  February 
1988,  a  CALCC  flight  over  Vandenberg 
AFB  successfully  demonstrated 
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Peacekeeper  remote  retargeting  capability. 
A  flight  test  in  April  1988  demonstrated 
successful  relay  transmissions  between  the 
CALCC  and  the  airborne  launch  control 
center. 

A  dry  run  test  of  the  eighteenth  missile 
flight  test  (FTS-18)  for  the  CALCC  was 
flown  in  May  1988.  This  flight  entailed 
demonstrating  all  launch  and  contingency 
procedures  for  an  FTS-18  launch  using 
the  CALCC.  Both  flight  and  ground  per¬ 
sonnel  were  involved  in  this  test,  and  suc¬ 
cessfully  accomplished  a  simulated  launch 
count  using  a  ground  test  missile.  Al¬ 
though  three  flights  still  remain  in  the  test 
jrogram,  DOT&E  agrees  with  the  Air 
"orce  that  it  is  prudent  to  delay  these 
lights  until  development  activity  and  reso- 
ution  of  anomalies  are  complete.  How¬ 
ever,  DOT&E  continues  to  stress  the  im¬ 
portance  of  completing  the  remaining 
flights  as  soon  as  possible.  FTS-18  is 
scheduled  for  the  first  quarter  of  1989  and 
will  evaluate  operational  software  and 
hardware.  FTS-19  and  20  are  scheduled 
during  the  last  quarter  of  1989. 

OT&E  ASSESSMENT 

We  evaluate  reentry  vehicle  accuracy  in 
terms  of  circular  error  probable  (CEP). 
Although  during  testing  some  reentry  vehi¬ 
cles  impacted  slightly  outside  the  pre¬ 
specified  circle  size,  the  overall  CEP  is 
within  that  circle.  We  consider  three  of  the 
17  missions  flown  to  date  to  have  been  op¬ 
erationally  representative  in  terms  of  hard¬ 
ware,  software,  and  procedures.  The  com¬ 
posite  accuracy  on  those  three  was  also 
within  the  specified  CEP  value.  The  cal¬ 


culated  mission  effectiveness  factor  ex¬ 
ceeds  SAC  requirements.  Probability  of 
damage  (Pd)  calculations  for  all  17  flights 
resulted  in  a  value  which  is  also  better 
than  that  specified  by  SAC.  The  calcu¬ 
lated  Pd  for  the  operationally  representa¬ 
tive  missions  also  exceeds  the  SAC  re¬ 
quirement.  Tests  of  the  CALCC 
demonstrated  the  capability  to  transmit 
critical  launch  commands.  Delays  in  deliv¬ 
eries  of  operational  inertial  measurement 
units  (IMUs),  which  plagued  the  system 
last  year,  are  no  longer  a  problem.  All 
but  three  operational  Peacekeeper  missiles 
are  in  place  in  their  designated  silos.  The 
final  three  should  be  delivered  by  the  end 
of  CY88. 

SUMMARY 

Although  some  engineering  tasks  remain 
and  there  is  a  continuing  effort  to  correct 
the  small  impact  errors  experienced,  accu¬ 
racy  and  reliability  during  flight  are  excep¬ 
tional.  The  need  to  supply  operational 
units  with  operational  guidance  systems 
has  delayed  the  remaining  three  test 
launches.  Specific  delays  were  caused  by 
poor  reliability  of  the  accelerometer  in  the 
EMUs.  Overall,  the  OT&E  for 
Peacekeeper  in  Minuteman  silos  is  pro¬ 
gressing  satisfactorily.  The  next  launch, 
FTS-18,  is  expected  to  answer  several  of 
the  remaining  OT&E  questions.  Specifi¬ 
cally,  this  flight  will  determine  if  the 
Peacekeeper  can  be  launched  by  the 
CALCC  aircraft  and  if  satisfactory  relay 
capability  can  be  demonstrated  from  one 
CALCC  to  another.  It  will  also  demon¬ 
strate  a  missile  launch  using  battery 
power. 
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SYSTEM  DESCRIPTION 

The  Tacit  Rainbow  is  an  attack  missile 
system  which  is  capable  of  searching  out 
and  attacking  enemy  radar  targets  in  such 
mission  areas  as  defense  supression, 
counter  air,  interdiction,  and  close  air  sup¬ 
port.  Elements  of  the  system  include  the 
missile,  mission  planning  systems,  and  a 
rotary  launcher  for  the  B-52.  The  missile 
is  programmable  before  launch  and  can 
loiter  while  waiting  for  targets.  The  Tacit 
Rainbow  missile  will  be  carried  externally 
on  the  Navy  A-6E  and  internally  on  the 
Air  Force  B-52. 

BACKGROUND 

Tacit  Rainbow  was  initiated  as  a  directed 
sole  source  program  in  July  1981  for  full- 


scale  development  (FSD)  of  a  low-cost, 
modular,  autonomous  missile  capable  of 
searching  out  and  attacking  enemy  air  de¬ 
fense  radars.  FSD  was  authorized  in  June 
1986.  Tacit  Rainbow  contractor  develop¬ 
ment  testing  began  in  April  1987.  The 
DOT&E  approved  the  initial  TEMP  for 
Tacit  Rainbow  in  November  1987.  Com¬ 
bined  DT/OT  was  scheduled  to  begin  in 
October  1987,  but  has  been  delayed  for 
more  than  a  year  due  to  technical  prob¬ 
lems  encountered  in  contractor  testing. 

OT&E  ISSUES 

To  date,  operational  test  planning  has 
identified  critical  issues  for  evaluation 
which  include  guidance,  availability',  reli¬ 
ability,  lethality,  interoperability,  compati¬ 
bility,  sortie  generation,  and  mission  plan- 
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ning.  DOT&E  considers  known  limitations 
to  test  to  be  excessive. 

OT&E  ACTIVITY 

There  has  been  no  operational  test  and 
evaluation  of  Tacit  Rainbow  in  FY88  or 
prior  years.  IOT&E  is  scheduled  to  begin 
in  FY89. 
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SYSTEM  DESCRIPTION 


The  Future  Secure  Voice  System  (FSVS) 
program  was  initiated  by  the  National  Se¬ 
curity  Agency  (NSA)  to  significantly  en¬ 
hance  the  security  of  US  telephone  com¬ 
munications.  The  FSVS  consists  of 
various  types  of  Secure  Telephone  Unit 
(STU)  terminals  and  Key  Management 
System  (KMS)  elements.  FSVS  STU  ter¬ 
minal  types  are  the  low  cost  terminal 
(LCT),  or.  STU-IHZLCT,  offered  in  Type  I 
and  Type  n  versions  (described  below); 
STU-D3/Cellular,  to  provide  secure  cellu¬ 
lar  radio  telephones;  the  Automatic  Re¬ 
mote  STU  (ARSTU),  to  provide  a  red 
switch  interface;  the  STU-IDA,  a  STU-II 
compatible  version;  and  the  STU-m/MPT, 
a  mobile  version  ruggedized  for  aircraft 


and  mobile  platforms.  The  KMS  includes 
the  Key  Management  Center  (KMC)  and 
Key  Material  Ordering  and  Distribution 
Centers  (KMODC).  A  KMS  Rekey  Simu¬ 
lator  (RKS)  was  used  at  the  KMC  for  test 
purposes  during  operational  test  and 
evaluation. 

The  hub  of  the  KMS  is  the  KMC  for 
the  National  Security  Agency,  and  the 
communications  security  (COMSEC)  cus¬ 
todians  or  other  personnel  responsible  for 
local  issue  and  control  of  terminals  and 
keying  materials  for  users.  For  Type  I  ter¬ 
minals,  two  keying  options  are  available 
(seed  key  and  operational  key).  Either  of 
the  two  keying  options  can  be  loaded  into 
an  EEPROM  embedded  in  a  plastic  mate¬ 
rial  that  is  shaped  like  an  automobile  igni¬ 
tion  key  and  called  the  KSD-64A.  The 
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user’s  terminal  is  keyed  by  proper  use  of 
the  KSD-64A,  which  has  been  loaded  with 
keying  material  for  transfer  to  the  termi¬ 
nal.  The  KSD-64A  becomes  the  crypto  ig¬ 
nition  key  (CK)  for  the  terminal  after 
transfer  of  the  keying  material.  Rekeying 
requires  interaction  with  the  KMS  and/or 
local  COMSEC  custodian. 

Type  I  terminals  offer  full  security  up 
to  ana  including  Top  Secret  and  compart- 
mented  levels.  Type  n  terminals  are  in¬ 
tended  for  the  protection  of  unclassified 
national  security-related  traffic  and  pri¬ 
vacy,  and  are  interoperable  with  Type  I 
terminals. 

STU-1H/LCT-I  is  a  microprocessor- 
based  secure  voice/data  terminal  being  de¬ 
veloped  and  manufactured  by  three  ven¬ 
dors:  AT&T,  Motorola,  and  RCA.  These 
equipments  are  interoperable  and  can  op¬ 
erate  as  a  “Plain  Old  Telephone  System” 
(POTS)  for  unsecured  analog  transmis¬ 
sion.  Proper  use  of  a  KSD-64A  CK  en¬ 
ables  the  terminals  to  achieve  secure  voice 
or  data  operation  at  2.4  Kilobits  per  sec¬ 
ond  (Kbps),  using  a  linear  predictive  cod¬ 
ing  (LPC)  voice  algorithm  designated  the 
LPClOe.  The  AT&T  terminals  can  oper¬ 
ate  at  4.8  Kbps  in  secure  voice  or  data 
modes  when  communicating  with  another 
AT&T  terminal.  The  National  Security 
Agency  indicates  that  future  enhance¬ 
ments  will  include  the  requirement  for  all 
terminals  to  include  4.8  Kbps  capability, 
and  that  Motorola  plans  to  include  a  9.6 
Kbps  rate  capability  in  1989.  Higher  data 
rate  terminal  design  is  related  to  data 
transmission  capability  and  the  continuing 
efforts  to  improve  secure  voice  quality. 

BACKGROUND 

The  FSVS  program  was  initiated  in  March 
1984  in  response  to  the  widely  recognized 
need  to  significantly  enhance  US  tele¬ 
hone  security.  In  September  1985  the 
ecretary  of  Defense  issued  a  tasking  to 
survey  telephone  security  requirements. 


Service/agency  required  characteristics/ca¬ 
pabilities  and  planned  operational  quanti¬ 
ties  were  consolidated  and  promulgated  by 
the  Joint  Chiefs  of  Staff.  The  National  Se¬ 
curity  Agency  established  a  test  program 
for  the  STU-K/LCT  to  implement  the 
September  1985  tasking  of  the  Secretary 
of  Defense:  “Instead  of  the  traditional  and 
extensive  cycle  of  Service  developmental/ 
operational  testing  and  evaluation,  the  Di¬ 
rector,  NSA  shall  conduct  an  accelerated 
test  program  of  the  STU-DI  equipments.” 
The  National  Security  Agency  strategy  in¬ 
cluded  four  phases  of  testing,  including 
vendor  acceptance  testing,  system  integra¬ 
tion  at  the  FSVS  interoperability  test  bed, 
field  testing,  and  a  market  determination/ 
user  acceptance  phase. 

The  STU-IH/LCT  acquisition  program 
represented  a  considerable  departure  from 
traditional  acquisition  strategies,  coupling 
market-driven  competition  with  an  inte¬ 
grated  development,  test,  and  procure¬ 
ment  process  to  achieve  initial  prototype 
fielding  of  the  system  in  1987.  The  strat¬ 
egy  strongly  emphasizes  streamlining  the 
acquisition  process  through  creation  of 
vendor  incentive  to  build  a  high-quality 
product  and  provide  responsive  service  in 
order  to  remain  competitive  in  the  market¬ 
place,  including  DoD.  The  strategy,  how¬ 
ever,  did  not  initially  include  adequate  in¬ 
dependent  operational  test  and  evaluation 
in  accordance  with  10  U.S.C.  138. 

The  DOT&E  designated  the  FSVS 
STU-ffl  program  for  oversight  in  April 
1986  and  began  efforts  to  increase  the  use 
of  independent  user-representative  test 
agents  for  operational  test  and  evaluation 
in  the  field.  This  effort  led  to  the  submis¬ 
sion  of  an  NSA  prepared  Test  and  Evalu¬ 
ation  Master  Plan  (TEMP),  which  included 
an  Air  Force  TEMP  and  the  Air  Force’s 
1815th  Operational  Test  and  Evaluation 
Sauadron  (OTES)  detailed  test  plan. 
DOT&E  also  worked  with  the  independent 
operational  test  agents  of  the  Army  and 
Navy  to  obtain,  in  February  1988,  accep- 


VI-2 


SECURE  TELEPHONE  UNIT  - 
THIRD  GENERATION 
(STU-III) 


NATIONAL  SECURITY 
AGENCY 


tance  of  the  combined  operational  testing 
as  structured  by  NSA  and  the  Air  Force  in 
their  combined  TEMP  and  detailed  test 
plan.  The  Army  and  Navy  will  also  con¬ 
duct  separate  tests  of  the  STU-DI  in  their 
unique  applications  and  for  inter¬ 
operability  with  other  agencies. 

OT&E  ISSUES 

Critical  operational  issues  include:  Does 
STU-in  work  over  all  required  transmis¬ 
sion  media?  Does  STU-DI  integrate  and 
operate  in  all  required  environments? 
Does  STU-ffl  meet  security  requirements 
and  provide  effective  security  of  the  infor¬ 
mation  to  be  protected?  Does  STU-DI  in¬ 
terface  with  other  communications  system 
elements?  Critical  suitability  issues  in¬ 
clude:  Can  the  STU-DI  be  operated  and 
maintained  safely  with  the  plans,  training, 
manuals/data,  facilities,  and  the  tools  and 
test  equipment  provided?  Does  the  STU- 
DI  meet  the  established  reliability  and 
maintainability  criteria? 

Limitations  noted  during  OT&E  in¬ 
cluded  the  maturity  of  the  terminals  and 
KMS,  which  was  reflected  in  the  terminal 
lock-up  and  zeroization.  A  full  opera¬ 
tional  KMS  with  involvement  of  local 
COMSEC  custodians  who  will  process  and 
control  terminals  and  keying  material  is 
required  to  realistically  assess  field  system 
operation.  Multi-Service  and  NSA  COM¬ 
SEC  material  handling  aspects  and  logis¬ 
tics  support  plans  were  not  evaluated  un¬ 
der  operational  conditions.  Operational 
use  of  contractor  personnel  requires  clari¬ 
fication.  These  limitations  do  not  invali¬ 
date  the  test  results,  but  require  resolution 
in  the  planning  and  approval  of  follow-on 
operational  test  and  evaluation. 

Operational  effectiveness  and  opera¬ 
tional  suitability  issues  remain  to  be  re¬ 
solved  by  follow-on  operational  test  and 
evaluation  of  the  STU-ffl/LCT-I  and  new 
emerging  components  in  the  FSVS  pro¬ 
gram.  A  new  TEMP  and  new  operational 


test  plans  are  required  for  the  follow-on 
operational  test  and  evaluation. 

OT&E  ACTIVITY 

The  independent  field  phase  of  STU-DI/ 
LCT-I  (operational  test  and  evaluation  of 
the  STU-DI)  was  conducted  by  the  Air 
Force  Communications  Command 
(AFCC),  1815th  Operational  Test  and 
Evaluation  Squadron  (OTES)  at  24  sites 
throughout  the  Pacific  and  the  Continental 
US  during  the  period  April-June  1988. 
Operational  test  and  evaluation  was  con¬ 
ducted  in  accordance  with  the  approved 
Qualification  Operational  Test  and  Evalu¬ 
ation  (QOT&E)  plan.  The  1815th  OTES 
prepared  an  interim  test  report  (August 
1988)  which  was  released  to  Headquarters 
Air  Force  by  AFCC  on  September  9, 
1988.  The  Air  Force  Operational  Test  and 
Evaluation  Center  (AFOTEC)  monitored 
the  QOT&E  and  concurred  in  the  overall 
conclusions  of  the  QOT&E  report.  These 
reports  have  been  reviewed  by  NSA.  NSA 
reported  results  of  its  four  test  phases, 
data  from  the  various  Service  and  NSA  ac¬ 
tivities,  and  other  related  testing  in  a  re¬ 
port  dated  August  15,  1988. 

The  DOT&E  prepared  a  beyond  low- 
rate  initial  production  report  in  accordance 
with  10  U.S.C.  138.  This  report,  dated 
November  15,  1988,  was  forwarded  to 
Congress  by  the  Secretary  of  Defense  on 
December  12,  1988. 

OT&E  ASSESSMENT 

The  DOT&E  overall  assessment  of  FSVS 
operational  effectiveness  is  marginal  for 
the  system  as  tested,  including  the  test 
planning  and  conduct  of  tests  with  the 
KMS  and  STU-DI/LCT-I  terminals.  Mar¬ 
ginal  implies  less  than  satisfactory,  but  not 
unsatisfactory;  the  equipment  demon¬ 
strates  capability  and  can  be  used,  but  it 
needs  improvement.  KMS  operation,  to 
include  the  COMSEC  custodian  personnel, 
and  improved  voice  quality  are  critical  op¬ 
erational  effectiveness  issues  for  resolu- 
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tion  in  the  follow-on  operational  test  and 
evaluation.  Although  limited,  the  QOT&E 
and  NSA  test  results  confirm  that  the 
STU-m/LCT-I  has  strong  potential  to  be 
operationally  effective  for  POTS  and  se¬ 
cure  voice  communications. 

Service  reports  were  also  prepared  to 
identify  terminal  malfunctions,  deficien¬ 
cies,  and  shortfalls.  Twenty-five  reports 
were  submitted  during  QOT&E.  Eleven 
were  rated  mission  essential  and  involved 
two  equipment  problems  of  system  lock¬ 
up  and  system  zeroization.  During  lock¬ 
up,  the  terminal  was  not  usable  as  a  POTS 
or  a  secure  terminal  until  the  power  was 
removed  and  reapplied.  The  RCA  termi¬ 
nals  locked-up  four  times  and  the  AT&T 
terminals  twice.  Terminals  zeroized  over¬ 
night  and  prevented  their  use  as  secure 
terminals  until  receipt  of  new  keying  mate¬ 
rial.  The  AT&T  and  Motorola  terminals 
zeroized  twice  and  the  RCA  terminal 
once.  NSA  indicates  that  all  vendors  have 
corrected  these  two  problems  by  changes 
in  software  which  is  available  in  terminals 
scheduled  for  European  tests  which 
started  September  26,  1988.  The  DOT&E 
assessment  is  that  the  vendor  changes 
should  be  evaluated  by  the  1815th  OTES 
during  the  European  tests  and  results  in¬ 
cluded  in  the  report  on  these  tests. 

Objectives  for  operation  in  airborne 
applications  were  not  determined,  but  will 
be  conducted  and  reported  later.  Objec¬ 
tives  for  operations  in  tactical  applications 
were  not  determined,  but  have  been  as¬ 
sessed  and  reported  as  feasible  for  the  2.4 
Kbps  data  rates  by  the  Joint  Tactical  Com¬ 
mand,  Control,  and  Communications 
Agency  (JTC3A)  based  on  technical  test¬ 
ing  through  July  1988  at  Fort  Huachuca, 
Arizona. 

Subjective  comments  and  observations 
by  QOT&E  personnel  were  provided  on 
special  features  or  options  of  the  various 
terminals.  The  AT&T  terminal  provided 
4.8  Kbps  operation  with  another  AT&T 


terminal.  It  also  provided  frequency  off¬ 
set,  which  was  used  in  Korea  to  compen¬ 
sate  for  poor  quality  lines.  In  addition,  the 
AT&T  terminal  provided  Hayes  compat¬ 
ible  commands  for  operation  of  the  inter¬ 
nal  modem.  The  Motorola  terminal  was 
most  compact.  It  offered  POTS  operation 
without  power,  and  had  one-button  trans¬ 
ferring  to  halfduplex  operation.  The  RCA 
terminal  incorporated  the  overseas  re¬ 
quirements  in  Continental  US  terminals 
and  had  simultaneous  two/four  wire  opera¬ 
tion  capability. 

The  DOT&E  overall  assessment  of 
FSVS  operational  suitability  is  marginal 
for  the  system  as  tested,  including  the  test 
planning  and  conduct  of  tests  with  the 
KMS  and  STU-III/LCT-I  terminals.  Mar¬ 
ginal  implies  less  than  satisfactory  but  not 
unsatisfactory;  the  equipment  demon¬ 
strates  capability  and  can  be  used,  but  it 
needs  improvement.  KMS  operation  to  in¬ 
clude  COMSEC  custodian  personnel  and 
improved  planning  for  life-cycie  support 
are  critical  operational  suitability  issues 
for  resolution  in  the  follow-on  operational 
test  and  evaluation. 

Independent  operational  testing,  al¬ 
though  limited,  was  adequate  to  assess  op¬ 
erational  effectiveness  and  operational 
suitability  of  the  STU-III/LCT-I.  Follow- 
on  operational  test  and  evaluation  is  re¬ 
quired  to  confirm  correction  of  deficien¬ 
cies  which  resulted  in  the  marginal 
ratings,  to  assess  enhancements,  and  to 
assess  all  emerging  FSVS  terminals  with 
the  KMS  and  COMSEC  custodians. 

Test  planning  has  improved  in  the  last 
year,  but  requires  continued  attention  to 
complete  plans  for  the  required  follow-on 
operational  test  and  evaluation  of  the  cor¬ 
rections  for  deficiencies  noted  during 
QOT&E,  and  confirmation  of  operational 
effectiveness  of  enhancements  and  emerg¬ 
ing  STU-ffl  components  in  the  FSVS  pro¬ 
gram.  KMS  operation,  to  include  the 
COMSEC  custodian  personnel  and  im¬ 
proved  voice  quality,  are  critical  opera- 
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tional  effectiveness  issues  for  resolution  in 
the  follow-on  operational  test  and  evalu¬ 
ation.  Although  limited,  the  QOT&E  and 
NSA  test  results  confirm  that  the  STU-m/ 
LCT-I  has  strong  potential  to  be  opera¬ 
tionally  effective  for  POTS  and  secure 
voice  communications. 

Limitations  included  the  maturity  of 
the  terminals  and  key  management  sys¬ 
tem,  which  was  reflected  in  terminal  lock¬ 
up  and  zeroization.  A  full  operational 
KMS  with  involvement  of  local  COMSEC 
custodians  who  will  process  and  control 
terminals  and  keying  material  is  required 
to  realistically  assess  field  system  opera¬ 
tion.  Multi-Service  and  NSA  COMSEC 
material  handling  aspects  and  logistics 
support  plans  were  not  evaluated  under 
operational  conditions.  Use  of  contractor 
personnel  needs  to  be  clarified.  These 
limitations  do  not  invalidate  the  test  re¬ 
sults,  but  will  require  resolution  in  the 
planning  and  approval  of  follow-on  opera¬ 
tional  test  and  evaluation. 


DOT&E  representatives  observed  test¬ 
ing  at  selected  sites,  observing  KMC  op¬ 


erations  and  visiting  AFCC  and  1815th 
OTES  test  sites  during  testing. 

SUMMARY 

Independent  operational  testing,  although 
limited,  was  adequate  to  determine  opera¬ 
tional  effectiveness  and  suitability  as  mar¬ 
ginal  for  the  systems  tested.  Marginal  im¬ 
plies  that  the  system  is  usable  but  needs 
Improvements.  Observed  terminal  reli¬ 
ability  and  usability  have  been  acceptable. 
The  system  has  strong  potential  to  be  op¬ 
erationally  effective  and  suitable. 

Follow-on  independent  operational  test 
and  evaluation  is  required.  Improved  inter¬ 
operable  secure  voice  quality,  KMS  opera¬ 
tion  (to  include  the  user  COMSEC  custodi¬ 
an  personnel),  and  maintenance  plan 
completion  and  implementation  are  criti¬ 
cal  issues  for  resolution  in  the  follow-on 
independent  operational  test  and  evalu¬ 
ation. 

The  FSVS  remains  on  our  list  of  DoD 
programs  designated  for  operational  test 
and  evaluation  oversight.  A  new  FSVS 
TEMP  and  new  operational  test  plans  are 
required  for  follow-on  operational  testing 
of  STU-in/LCT-I  and  new  emerging  com¬ 
ponents  in  the  FSVS  program. 
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Director,  Operational  Test  & 

Evaluation  Beyond  Low-Rate 
Initial  Production  Reports  on: 

CV  Inner-Zone  Antisubmarine  Warfare  Helicopter  (April  1,  1988)* 

MK-53E  Helicopter  (May  11,  1988)  VTI-1 

S-3A  Weapon  System  Improvement  Program  (WSIP)  (S-3B) 

(June  13,  1988)* 

Bigeye  Chemical  Bomb  (August  30,  1988)* 

OH-58D  Army  Helicopter  Improvement  Program  (AHEP) 

Scout/Reconnaissance  Role  (September  9,  1988)* 

Secure  Telephone  Unit  -  Third  Generation  (STU-HI) 

(November  15,  1988)  VH-19 

Mobile  Subscriber  Equipment  (MSE)  System  (December  5,  1988)  VII-31 

MK  48  Advanced  Capability  (ADCAP)  Torpedo  (December  8,  1988)* 

M9  Armored  Combat  Earthmover  (M9  ACE)  (December  14,  1988)  VE-43 

Low  Altitude  Navigation  and  Targeting  Infrared  System 
for  Night  (LANTIRN)  Targeting  Pod  (December  19,  1988)  YU-55 


•These  reports  are  classified  and  have  been  removed  from  this  document.  They  are 
included  in  the  classified  version  of  this  report  and  are  available  for  review  on  a  need- 
to-know  basis. 
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OFFICE  OF  THE  SECRETARY  OF  DEFENSE 
WASHINGTON,  D.C.  20301-1700 


11  May  1988 

OPERATIONAL  TEST  AND  EVALUATION  REPORT 

ON  THE 

MH-53E  HELICOPTER 

The  Office  of  the  Director,  Operational  Test  and  Evaluation 
has  completed  its  assessment  of  the  MH-53E  helicopter.  This 
report  is  being  submitted  in  fulfillment  of  the  provisions  of 
10  U.S.C.  138  because,  in  the  judgment  of  the  Director,  the  Navy 
proceeded  beyond  low-rate  initial  production  when  it  recently 
committed  to  procure  eight  additional  MH-53ES.  Procurement  in 
prior  years  consisted  of  17  MH-53Es  of  the  total  planned  buy  of  32. 

The  MH-53E ' s  recent  follow-on  operational  test  and  evaluation 
( FOT&E )  was  adequate  to  assess  the  operational  effectiveness  and 
suitability  of  the  production  MH-53E  helicopter  in  its  primary 
mission  of  streaming,  towing,  and  recovering  airborne  mine 
countermeasures  (AMCM)  equipment.  Limitations  to  test  primarily 
involved  the  inability  to  evaluate  corrections  to  previously 
identified  major  deficiencies.  Because  of  the  long  lead  times 
required  to  make  these  corrections,  they  were  not  available  for 
evaluation  during  this  most  recent  phase  of  testing. 

As  tested  in  FOT&E,  the  MH-53E  was  considered  only  marginally 
operationally  effective  and  not  operationally  suitable.  The 
inability  to  precisely  navigate  and  numerous  major  suitability 
problems  directly  affected  the  MH-53E's  operational 
effectiveness.  Significant  problems,  some  of  which  require 
long-term  solutions,  in  reliability,  maintainability, 
compatibility,  interoperability,  safety,  and  human  factors 
resulted  in  the  MH-53E  being  not  operationally  suitable.  Recent 
positive  actions  have  been  taken  by  the  Navy  to  correct  some  of 
the  deficiencies  through  procedural  and  hardware  changes.  The 
procedural  changes  observed  by  a  DOT&E  representative  appear 
effective.  These  procedural  changes,  planned  hardware  changes, 
and  the  inherent  capability  of  the  MH-53E  clearly  indicate  the 
potential  for  satisfactory  effectiveness  and  suitability  in  the 
AMCM  mission. 


OPERATIONAL  TEST 
AND, EVALUATION 


A  description  of  the  MH-53E  and  the  operational  tests 
conducted,  together  with  amplifying  information  on  operational 
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SYSTEM  DESCRIPTION 


The  KH-53E  is  a  modified  version  of  the  Navy  and. Marine  Corps 
CH-53E.  The  CH-53E,  in  turn,  is  an  improved/growth  version  of  the 
Navy /Marine  Corps  H-53  A/D  transport  helicopter.  Both  the  CH-53E 
and  MH-53E  feature  a  third  engine,  a  larger  diameter  rotor,  seven 
(versus  six)  main  rotor  blades,  an  uprated  main  transmission,  and 
greater  maximum  gross  weight  and  payload  capability  over  the  H-53 
A/D.  The  CH-53E  is  currently  in  full  production,  while  the  MH-53E 
has  remained  in  low-rate  production  (four  in  FY87)  after  the 
initial  procurement  in  FY86  of  12  MH-53E  aircraft.  Seventeen  of  a 
planned  32  MH-53Es  have  been  funded. 

There  is  approximately  80%  commonality  between  the  MH  and  CH 
aircraft,  with  the  main  rotor,  engines,  transmission  and  basic 
airframe  being  essentially  the  same.  Modifications  to  the  CH-53E 
airframe  that  are  required  for  an  MH-53E  are  the  following: 
enlarged  fuel  sponsons,  rear  escape  hatches,  equipment  stowage  box 
tow  boom,  boom  back-up  structure,  winch  control  system,  mounting 
provisions  for  a  mission  navigation  system,  Mk  105  refueling 
provisions,  egress  lighting,  tow  cable  guillotine  provisions, 
airborne  mine  countermeasures  (AMCM)  mirrors,  tension-skew 
indicator  (pilot's  primary  cockpit  indication  of  tension  and  skew 
angle  of  the  AMCM  device),  dual  digital  automatic  flight  control 
system  (AFCS),  composite  tail  rotor,  90  degree  stub  ramp,  doppler 
navigation  system,  and  a  second  radar  altimeter. 

The  MH-53E  was  developed  to  replace  the  RH-53D  as  the  Navy's 
AMCM  platform.  According  to  the  Decision  Coordinating  Paper, 
approved  in  April  1978,  the  MH-53E  was  to  be  fully  capable  of 
employing  all  AMCM  equipment,  and  to  provide  the  increased  tow 
tension  required  by  proposed  AMCM  devices,  increased  time  on 
station,  and  improved  mission  reliability. 

The  MH-53E  is  capable  of  daylight-only  towing  of  various  mine 
countermeasures  equipment  in  the  mine  sweeping  or  mine  hunting 
roles.  During  testing,  the  MH-53E  used  the  Mk  103  mechanical  mine 
sweeping  device,  Mk  104  acoustic  AMCM  device,  Mk  105  magnetic  AMCM 
sled,  AQS-14  minehunting  sonar,  SPU-l-W  magnetic  orange  pipe,  and 
ALQ-141  countermeasures  set.  In  addition,  the  aircraft  has  the 
capability  of  performing  vertical  onboard  deliveries  and  other 
special  missions  as  assigned. 
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TESTING  ADEQUACY 

Initial  operational  test  and  evaluation  (IOT&E)  of  the  MH-53E 
was  completed  on  31  July  1984.  A  limited  production  decision  for 
12  MH-53E  aircraft  was  made  in  April  1985,  based  on  the  results  of 
initial  development  testing  and  IOT&E.  Technical  evaluation  was 
completed  8  November  1985  and  operational  evaluation  (OPEVAL)  was 
completed  25  April  1986.  Results  of  OPEVAL  on  a  prototype  MH-53E 
(modified  CH-53E)  were  briefed  to  the  Director,  Operational  and 
Evaluation,  and  reported  in  the  DOT&E  FY86  Annual  Report.  At  that 
time,  the  MH-53E  was  judged  operationally  effective,  given 
possible  operational  limitations,  and  not  operationally  suitable. 
The  Director  stated  to  the  Navy  that  the  OPEVAL  test  results  did 
not  support  full  production  of  the  MH-53E  until  identified 
discrepancies  were  corrected  and  verified  in  further  operational 
testing. 

A  Milestone  IIIB  decision,  which  considered  the  OPEVAL  test 
results,  was  made  by  the  Navy  on  7  November  1986.  The  Navy 
approved  the  MH-53E  for  fleet  introduction,  approved  limited 
production  (four  aircraft)  for  FY87,  and  directed  follow-on 
operational  test  and  evaluation  with  production  aircraft  for 
verification  of  deficiency  corrections. 

After  the  Milestone  IIIB  decision  for  low-rate  production, 
the  Navy  directed  follow-on  operational  test  and  evaluation 
( FOT&E )  to  verify  correction  of  safety,  human  factors,  training, 
and  documentation  deficiencies  observed  in  OPEVAL.  Assessment  of 
the  operational  effectiveness  and  suitability  of  "interim" 
solutions  to  the  problems  of  operating  with  one  engine  out, 
excessive  main  and  tail  rotor  bearing  wear,  and  excessive  noise 
was  also  directed.  The  testing  of  aircraft  availability  (a 
previous  major  deficiency)  during  FOT&E  was  waived  when  a 
snap-ring  bearing  improvement  program  could  not  be  incorporated  in 
production-representative  MH-53Es  in  time  to  complete  FOT&E. 

The  T64-GE-4 19  engine  upgrade  for  greater  thrust, 
tension-skew  indicator  (TSI)  improvements,  and  intercommunications 
system  (ICS)  modifications  to  provide  for  an  active  noise 
reduction  system  were  documented  limitations  to  test  (and  were  not 
available  for  testing).  They  require  long-term  solutions  which 
are  scheduled  for  testing  during  FY89  and  FY90.  Improved  rotor 
bearings  and  snap-ring  bearing  collars  were  anticipated  to  be 
available  for  test.  However,  they  were  not  available  and  were 
rescheduled  for  testing  in  FY89. 


UNCUSS  IF!  ED 


VII-5 


UNCLASSIFIED 


The  Test  and  Evaluation  Master  Plan  (TEMP)  outlining  the 
updated  near-  and  far-term  test  plans  for  the  MH-53E  was  approved 
by  the  Director,  Operational  Test  and  Evaluation,  in  September 
1987.  The  Navy's  test  plan  for  FOT&E  was  briefed  to  and  approved 
by  the  Director  in  October  1987.  The  Director  noted  in  his  test 
plan  approval  memo  that,  because  the  planned  test  could  not  verify 
corrections  to  deficiencies  which  required  long-term  solutions, 
the  probable  test  results  would  still  not  support  a  full 
production  decision.  The  test  site  was  visited  by  a  DOT&E 
observer  during  the  conduct  of  the  test  and  the  progress  and 
results  of  testing  at  that  time  were  briefed  by  the  Navy's  Test 
Director.  Subsequent  to  testing,  a  DOT&E  observer  flew  on  an 
MH-53E  training  mission  during  which  the  stream,  tow,  and  recovery 
of  the  Mk-103  mechanical  mine  sweeping  device  were  accomplished. 

A  DOT&E  observer  also  saw  the  shore  launch  and  recovery  of  the 
Mk-105  magnetic  AMCM  sled. 

FOT&E  of  the  MH-53E  was  conducted  by  Commander,  Operational 
Test  and  Evaluation  Force  (COMOPTEVFOR)  at  NAS  Norfolk,  Virginia, 
from  19  October  to  20  November  1987  using  Helicopter  Mine  Squadron 
Twelve  (HM-12 )  flight  crews  and  maintenance  personnel  in 
accordance  with  the  TEMP  and  test  plan  approved  by  the  Director, 
Operational  Test  and  Evaluation.  One  production  aircraft  was 
available  for  AMCM  missions  from  19  October  to  29  October  1987. 
From  29  October  to  9  November  1987,  three  production  aircraft 
became  available  for  AMCM.  Only  one  AMCM  suite  consisting  of  the 
devices  shown  below  was  available  for  testing. 

A  total  of  159.2  flight  hours  were  distributed  as  follows: 


Mk  103  Mechanical  Minesweeping  Device  35.3 
Mk  104  Acoustic  AMCM  Device  7.0 
Mk  105  Magnetic  AMCM  Sled  7.4 
AQS-14  Minehunting  Sonar  1.2 
SPU-1-W  Magnetic  Orange  Pipe  3.5 
ALQ-141  Countermeasures  Set  3.5 
Helicopter  Inflight  Refueling  0.8 
Familiarization  100.5 


Evaluation  of  accurate  navigational  capability,  which  is 
required  for  effective  AMCM,  was  not  accomplished  during  this  test 
due  to  chronic  failure  of  the  Raydist  mission  navigation 
equipment . 
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Shipboard  operations  were  not  accomplished  in  this  phase  of 
test  and,  therefore,  corrections  to  deficiencies  observed  in 
earlier  testing  of  shipboard  operations  could  -not  be  verified. 
Completion  of  operational  shipboard  compatibility  and 
interoperability  is  scheduled  for  FY89  and  FY90. 

The  limitations  to  test  were  significant  and  had  a  major 
impact  on  the  test  and  evaluation  results.  However,  they  did  not 
preclude  a  final  assessment  of  the  MH-53E's  operational 
effectiveness  and  suitability  with  regard  to  its  current 
production  configuration. 

The  Director  concluded  the  OPTEVFOR  evaluation  report  was  of 
high  quality  and  accurately  reflected  the  results  of  testing. 
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OPERATIONAL  EFFECTIVENESS  AND  SUITABILITY 


Follow-on  operational  test  and  evaluation  (FOT&E)  of  the 
MH-53E ' s  operational  effectiveness  in  its  primary  airborne  mine 
countermeasures  (AMCM)  mission  was  so  limited  by  the  major 
suitability  problems  that  three  of  five  effectiveness  issues  could 
not  be  resolved.  Complete  resolution  of  the  suitability  problems 
will  require  long-term  efforts  in  development  and  testing.  In  the 
meantime,  the  MH-53E  is  considered  only  marginally  operationally 
effective,  although  recent  changes  in  AMCM  stream  and  recovery 
procedures  and  aircraft  employment  techniques  may  improve 
effectiveness . 

Effectiveness  test  objectives  for  operational  effectiveness 
included  the  capability  of  the  MH-53E  to  stream,  tow,  and  recover 
all  current  and  certified  developmental  AMCM  towed  bodies  and 
verifying  correction  of  previously  identified  OPEVAL 
deficiencies.  The  capability  of  an  add-on  mission  navigation 
system  (Raydist),  which  is  not  part  of  the  aircraft's  basic 
avionics  system,  to  support  the  AMCM  mission  was  also  assessed. 

One  other  operational  effectiveness  objective  assessed  the 
capability  of  the  MH-53E  to  refuel  in-flight  from  a  ship  while 
hovering. 

The  capability  of  the  MH-53E  to  deploy/stream  and  recover  the 
AMCM  equipment  was  qualitatively  assessed  by  observation  of 
airborne  streaming  and  recovery  evolutions  for  the  Mk  103,  Mk  104, 
AQS-14,  ALQ-141,  and  SPU-l-W  AMCM  devices  and  shore  launch  and 
recovery  of  the  Mk  105  sled. 

The  MH— 53E ' s  operational  effectiveness  was  directly  affected 
by  compatibility  with  current  AMCM  devices  and  procedures. 

Because  the  MH-53E  is  a  larger,  heavier,  and  more  powerful 
aircraft  than  the  RH-53D,  its  increased  rotor  downwash  and  noise 
levels  have  a  greater  impact  on  AMCM  mission  performance.  The 
highest  levels  of  mission  degradation  occurred  during  AMCM  stream 
and  recovery  operations.  The  majority  of  the  compatibility 
problems  observed  in  these  phases  of  the  mission  were  assessed  as 
safety  and  human  factors  issues  when  aircrews  attempted  to  work 
around  difficulties  encountered  in  flight. 

High  rotor  downwash  caused  both  device  and  cable  oscillations 
which,  in  turn,  resulted  in  cable  entanglements,  aircraft  strikes, 
degradation  of  electrical  connections  to  the  streamed  device,  and 
hazardous  conditions  for  the  crew.  These  problems,  in  combination 
with  high  acoustic  noise  levels  which  degrade  aircrew 
communications  during  flight,  raise  serious  concerns  and,  in 
several  instances,  were  causes  for  mission  aborts. 
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Operational  effectiveness  was  also  affected  by  an  uncorrected 
compatibility  deficiency  from  previous  testing  (recoverability 
with  single  engine  failure  while  towing  devices),  which  caused  the 
Navy  to  lower  allowable  fuel  weight,  thereby  limiting  the 
helicopter's  AMCM  on-station  time.  This  limited  on-station  time 
significantly  reduces  or  eliminates  tow  time  for  some  AMCM 
configurations,  particularly  in  warm  climates. 

Effectiveness  is  also  impacted  by  excessive  acoustic  noise 
levels,  which  was  a  previously  observed  and  uncorrected  deficiency 
from  OPEVAL.  Excessive  noise  levels  degraded  aircrew 
communications,  which  affected  mission  accomplishment  and  flight 
safety.  Safe  and  effective  mission  accomplishment  requires 
constant,  clear  communications  between  the  pilots'  cockpit  and  the 
crewmen's  work  area  at  the  rear  of  the  aircraft  cabin,  which  is  an 
open-air  environment.  This  loud  and  potentially  harmful  noise, 
w^ich  affects  the  entire  cabin  area,  is  generated  by  the  main  gear 
box,  engines,  and  rotor  downwash.  An  interim  Navy  resolution 
addresses  this  issue  by  making  special  provisions  for  protection 
of  aircrew  hearing  including  additional  ear  protectors  and  limits 
on  duty  time  in  high  noise  areas  of  the  aircraft.  During  this 
test,  aircrew  evaluations  showed  that  eighty  percent  of  the 
aircrew  felt  noise  levels  at  some  location  inside  the  aircraft 
were  uncomfortable,  while  twenty  percent  said  noise  was  not  a 
problem.  Seventy  percent  indicated  that  a  problem  with  the 
intercommunications  system  (ICS)  occurred  which  interfered  with 
their  jobs.  In  most  cases,  this  required  repeated  ICS  volume  or 
boom  mike  adjustments,  or  physically  repositioning  within  the 
aircraft  in  order  to  make  a  clear  transmission.  Increased 
attention  to  and  recent  improvements  in  applying  passive  noise 
reduction  techniques  appeared  to  make  a  positive  step  towards 
reducing  the  effect  of  the  high  noise  level  on  mission 
accomplishment,  safety,  and  hearing  conservation.  This  has  been 
accomplished  by  ensuring  each  aircrewman's  helmet  is  properly 
fitted  in  combination  with  ear  plugs.  During  a  Mk  103  AMCM 
flight,  the  DOT&E  observer  noted  the  cabin  noise  levels  were  lower 
than  anticipated  and  at  no  time  during  the  entire  mission  were 
there  any  communication  difficulties. between  the  pilots  and 
aircrewmen. 

Operational  effectiveness  during  streaming  and  recovery  was 
also  assessed  for  the  interface  (interoperability)  between  the 
MH-53E  and  the  subsystems  with  which  it  must  operate.  The 
interoperability  problems  noted  with  the  AMCM  equipment  generally 
involved  oscillations  of  the  AMCM  devices  due  to  rotor  wash  and/or 
unseated  cables  which  caused  hazards  to  the  crew,  the  airframe, 
and  potential  interference  with  the  tail  rotor.  AMCM 
configurations  and  interoperability  deficiencies  for  each  device 
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tested  were  documented.  Generally,  the  reason  these  problems 
occurred  was  inadequate  procedural  and  design  integration  of  the 
MH-53E  with  the  AMCM  equipment  that  did  not  account  for  all  the 
variables ' interacting  in  the  mission  environment  (aircrew 
experience,  tools  used,  procedures,  pilot  technique,  on-station 
weather,  sled  tension,  etc.).  Despite  the  basic  configuration 
similarity  of  AMCM  equipment  between  the  RH-53D  and  MH-53E  and  the 
high  experience  level  of  aircrewmen  (the  vast  majority  of  the 
aircrewmen  who  participated  in  testing  were  instructors  used  to 
train  fleet  entry  aircrewmen  on  AMCM  equipment  and  procedures), 
numerous  interface  problems  still  occurred  (RH-53D  procedures  and 
techniques  were  employed  for  the  MH-53E) .  Some  have  the  potential 
for  major  damage  to  equipment,  including  the  airframe,  and  serious 
injury  to  crew  members.  New  procedures,  which  were  recently 
developed  for  the  MH-53E  to  improve  the  capability  to  stream  and 
recover  the  AMCM  equipment,  were  observed  by  a  DOT&E 
representative.  These  new  procedures  appear  to  have  made 
significant  progress  in  addressing  the  helicopter/AMCM  interface 
deficiencies  and  have  a  high  potential  to  demonstrate  increased 
operational  effectiveness  and  suitability. 

After  the  AMCM  equipment  was  streamed,  the  MH-53E  was 
assessed  to  be  operationally  effective  in  towing  the  Mk  103, 

Mk  104,  Mk  105,  AQS-14,  ALQ-141,  and  SPU-l-W. 

Operational  effectiveness  was  also  qualitatively  assessed 
with  regard  to  human  factors.  Numerous  problems  were  observed 
with  cockpit  gauges,  status  lights,  and  indicators  that  did  not 
meet  the  requirements  necessary  for  pilots  and  copilots  to  conduct 
their  job  assignments  effectively.  In  the  cabin  area,  the 
location,  space,  or  other  characteristics  of  aircraft  equipment 
presented  or  caused  hazards  to  personnel  and  other  equipment . 

Many  maintenance  and  aircrew  tasks  were  inordinately  difficult  to 
perform. 

Operational  effectiveness  was  assessed  with  regard  to  safety 
features.  Safety  testing  was  conducted  continuously  during  the 
test  period.  The  most  significant  hazards  were  due  to  poor 
compatibility  and  interoperability  of  AMCM  equipment  with  the 
MH-53E  in  its  operational  environment.  Some  of  the  problems 
associated  with  interoperability,  safety,  and  human  factors  can  be 
mitigated  by  increased  familiarity  with  the  aircraft/equipment 
problems  and  improved  MH-53E  AMCM  streaming  and  recovery 
procedures  and  techniques,  as  was  seen  on  a  Mk  103  tow  mission  by 
a  DOT&E  observer . 

In  addition  to  the  MH-53E’s  capability  for  streaming,  towing 
and  recovering  AMCM  devices,  the  aircraft's  operational 
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effectiveness  was  intended  to  be  assessed  by  determining  the 
capability  cf  an  add-on  navigation  system  (which  is  not  part  of 
the  aircraft's  basic  avionics  suite)  to  support  the  AMCM  mission 
and  to  verify  previously  identified  deficiencies.  The  accuracy  of 
the  currently  used  Raydist  (contractor's  trademark  name) 
navigation  system  was  to  be  measured  by  flying  minefield  tracks 
with  reference  to  a  known  geographical  point.  On  sixteen  separate 
flights  designed  to  measure  navigational  accuracy,  the  Raydist 
system  was  inoperable  and,  therefore,  considered  not  effective. 

These  three  operational  effectiveness  objectives  -  streaming, 
recovery,  and  navigational  accuracy  -  in  the  MH-53‘s  primary 
mission  of  AMCM  encountered  major  problems  during  evaluation 
efforts  in  this  test.  Consequently,  the  integrated  weapon  system 
could  not  be  considered  operationally  effective  for  the  conduct  of 
the  primary  AMCM  mission  until  the  navigation  system  is  improved 
or  replaced  (the  Navy  has  indicated  a  replacement  effort  is 
currently  underway)  and  the  major  suitability  issues  of 
reliability,  maintainability,  compatibility,  interoperability, 
safety,  and  human  factors  are  further  examined  and  resolved. 

One  other  operational  effectiveness  objective,  the  capability 
of  the  MH-53E  to  refuel  from  a  ship  while  hovering  in  flight,  was 
assessed  during  this  test.  The  aircraft  demonstrated  the 
capability  to  conduct  daytime,  visual  flight  conditions,  hookups 
and  refueling  in  flight  with  the  USS  JOUETT.  Power  degradation 
did  occur  during  refueling,  when  30  minutes  of  flight  at  low 
altitude  resulted  in  the  aircraft  marginally  meeting  engine  power 
requirements  due  to  salt  spray  ingestion. 

Operational  suitability  of  the  MH-53E  was  observed  and 
evaluated  in  9  areas  (reliability,  maintainability,  logistics 
supportability,  compatibility,  interoperability,  training,  human 
factors,  safety  and  documentation).  Reliability  of  the  MH-53E  was 
measured  continuously  during  test  operations  to  determine  the 
probability  of  completing  a  4-hour  AMCM  mission  in  its  intended 
operational  environment  without  a  critical  or  major  failure.  (A 
critical  failure  prevents  the  system  from  performing  its  mission. 

A  major  failure  causes  the  system  to  lose  some  operational 
capability  and  degraded  mission  accomplishment.)  The  demonstrated 
mean  flight  hours  between  failures  (MFHBF)  was  2.9  hours  based  on 
54  critical  or  major  failures  in  159.2  flight  hours,  with  the 
criterion  being  7.6  hours.  The  54  failures  consisted  of  16 
Raydist  failures  and  38  non- Raydist  failures.  Of  these  latter  38, 
nine  were  bearing  failures. 

The  demonstrated  4-hour  mission  reliability  for  FOT&E  was 
0.26  based  on  54  failures,  with  a  criterion  of  0.59, 
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The  Raydist  equipment,  which  was  intended  to  provide 
adequate  capability  for  pilots  to  navigate  with  the  accuracy 
required  to  locate  and  mark  mines  in  a  simulated  mine  field, 
failed  in' all  16  flight  events  designed  to  test  navigation 
accuracy.  Because  the  Raydist  equipment  never  worked  and  is  not 
the  planned  final  configuration  navigation  equipment,  the 
inclusion  of  the  Raydist  failures  biases  the  estimate  of  MH-53E 
reliability.  Excluding  Raydist  failures  from  the  calculations, 
the  demonstrated  MFHBF.  was  4.2  hours  (criterion  7.6  hours)  and  the 
demonstrated  4-hour  mission  reliability  was  0.39  (criterion  0.59). 

A  second  characteristic  of  the  MH-53E  identified  in  previous 
testing  was  the  high  failure  rate  of  the  main  damper,  pitch 
control,  and  tail  link  bearings.  A  fix  for  the  bearing  failure 
problem  is  in  development,  but  has  not  yet  been  instituted  in  the 
MH-53E.  If  both  Raydist  and  bearing  failures  are  excluded  from 
the  reliability  calculations,  the  estimate  of  MFHBF  is  5.5  hours, 
and  the  estimated  4-hour  mission  reliability  is  0.48.  These 
numbers  reflect  a  system  containing  a  100%  reliable  replacement 
navigation  system  and  better  bearings  with  a  zero  failure  rate. 
Real  world  projections  of  anticipated  MFHBF  and  mission 
reliability  will  be  between  those  observed  and  5. 5/. 48. 

Operational  suitability  was  also  quantitatively  evaluated  by 
determining  the  maintainability  of  the  MH-53E  in  the  intended 
operational  environment  and  verifying  correction  of  OPEVAL 
deficiencies.  Aircrews  and  maintenance  personnel  documented  all 
failures  discovered  during  ground  maintenance,  preflight, 
post-flight,  or  in  flight.  Descriptions  of  the  failures, 
troubleshooting  procedures,  corrective  actions,  and  appropriate 
times  (repair  times,  maintenance  man-hours,  time  awaiting  parts) 
were  documented. 

The  demonstrated  mean  time  to  repair  (MTTR)  was  3.1  hours 
based  on  117.8  hours  to  repair  38  critical  and  major  failures, 
with  a  criterion  of  2.1  hours.  The  minimum  repair  time  was  0.4 
hours  and  the  maximum  was  7.0  hours.  Many  hours  were  spent  during 
testing  attempting  to  fix  the  Raydist  system,  but  it  was  never 
fully  operational.  This  time  was  not  included  in  the  calculations 
in  order  to  obtain  a  more  accurate  reflection  of  the  MTTR. 

One  third  of  the  repairs  were  completed  within  the  criterion 
time  of  2.1  hours.  Seventy-five  percent  of  the  repairs  were 
completed  in  less  than  4.2  hours,  and  25%  required  more  than  4.2 
hours. 

In  addition  to  the  quantitative  maintainability  results 
above,  a  number  of  qualitative  issues  were  noted  that  relate  to 
aircraft  maintainability.  Scheduled  maintenance  was  high  because 
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of  14/28-day  inspections,  15/25/50-hour  inspections,  and  100-hour 
phases.  When  conducting  extensive  tow  operations,  the  squadron 
performed  the  15-hour  inspection  on  a  nightly  basis  because  of  the 
high  bearing  failure  rates  associated  with  this  environment. 
Additionally,  corrosion  prevention  requirements  were  increased  due 
to  high  levels  of  salt  spray  exposure  when  towing  AMCM  devices. 

Maintainability  was  also  affected  by  the  incomplete 
implementation  of  the  logistic  support  effort,  causing  further 
delay  in  the  maintenance  cycle.  The  time  spent  awaiting  parts 
accounted  for  a  significant  portion  of  the  downtime  for  OPEVAL  and 
FOT&E . 

Evaluation  of  availability  in  the  previous  OPEVAL 
demonstrated  a  significant  deficiency  versus  criterion  primarily 
due  to  the  high  wear  rate  of  main  and  cail  rotor  pitch  control  and 
damper  bearings,  which,  coupled  with  time-consuming  maintenance 
procedures,  led  to  excessive  downtime  and  maintenance  costs  for 
the  MH-53E. 

Availability  was  not  evaluated  during  FOT&E  because  an 
interim  corrective  action  to  a  previously  identified  major 
deficiency  (improved  snap-ring  bearings)  was  not  available. 

Evaluation  of  the  logistics  supportability  of  the  MH-53E 
showed  that  maintenance  planning,  supply  support,  equipment,  and 
special  tools  were  major  problems.  The  planning  for  scheduled 
aircraft  maintenance  is  complicated  by  the  15-hour  damper  bearings 
inspection  and  the  detailed  corrosion  inspection  due  to  salt 
spray.  Maintenance  planning  becomes  even  more  difficult  when 
operating  from  a  ship.  Because  of  restrictions  placed  on  the 
MH-53E  when  operating  with  some  classes  of  ships,  a  great  deal  of 
maintenance  may  have  to  be  done  topside. 

The  MH-53E-peculiar  parts  support  program  was  identified  as 
having  numerous  problems.  Of  the  1,280  MH-53E-peculiar  parts  that 
had  been  identified  as  of  15  October  1987,  32%  (404  items)  had  not 
been  contracted  for.  A  consequence  of  the  large  number  of 
non-contracted  items  has  been  the  procurement  of  parts  on  an 
emergency  basis  (one-time  buy).  This  procedure  inevitably  led  to 
increased  costs  and  delivery  time  which  impacted  supply  support. 

Of  the  876  contracted  items,  55%  (482  items)  had  been  shipped,  44% 
(386  items)  were  scheduled  to  be  shipped  by  January  1989,  and  1% 
(eight  items)  were  scheduled  for  shipment  after  January  1989. 

An  example  is  the  automatic  flight  control  system  (AFCS) 
computer.  As  of  9  November  1987,  HM-12  had  experienced  seven  AFCS 
computer  failures.  Although  turnaround  time  was  fast  (2  days), 
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there  were  no  test  sets  available  for  the  computer  at  either  the 
Organizational  Level  or  Intermediate  Level.  The  availability  of 
the  computers  to  this  point  has  depended  on  the  ability  of 
Sikorsky  to  pull  "spares"  off  the  production  line. 

A  number  of  problems  also  appeared  in  the  warranty  program. 
Again,  a  prime  example  was  the  AFCS  computer.  In  each  instance  ofj 
a  computer  failure,  a  replacement  had  to  be  obtained  from  Sikorsky 
and  the  failed  computer  shipped  back  to  Sikorsky  for  repair. 
Although  turnaround  time  was  short  for  the  computer  failures,  this 
was  not  true  for  all  warranted  items  and  a  deployed  squadron  would 
be  faced  with  potentially  long  downtime  for  its  aircraft. 

Some  support  equipment  was  in  short  supply  or  not  available 
(e.g.,  a  fuel  quantity  test  set  required  for  phase  inspections). 
One  development  test  set  model  exists,  and  it  was  held  by  the 
Sikorsky  technical  representatives,  not  by  the  squadron. 

Support  equipment  {winches,  racks,  davits,  etc.)  .required  for 
the  AMCM  mission  was  in  critically  short  supply.  During  FOT&E, 
these  shortages  limited  aircraft  availability  for  AMCM  to  one  of 
the  three  MH-53Es  possessed  by  HM-12. 

The  compatibility  of  the  MH-53E  with  its  operational 
environment  was  previously  discussed  with  regard  to  operational 
effectiveness.  With  regard  to  suitability,  the  evaluation  showed 
evidence  of  physical  and  functional  incompatibility.  Aircrew 
members  and  maintenance  personnel  documented  qualitative  evidence 
of  incompatibility  on  questionnaires.  As  discussed,  the  MH-53E's 
increased  rotor  downwash  and  noise  levels  had  a  greater  impact  on 
mission  performance  than  is  seen  with  the  current  RH-53Ds.  The 
highest  levels  of  degradation  occurred  during  AMCM  stream  and 
recovery  evolutions. 

Mission  delays  and  aborts  occurred  at  a  great  frequency 
during  AMCM  missions.  High  rotor  downwash,  which  caused  AMCM 
device  oscillations,  and  noise  levels,  which  degraded  aircrew 
communications,  were  considered  the  primary  causal  factors.  In 
52%  of  AMCM  flights,  a  mission  abort  or  significant  delay  was 
observed.  In  82%,  an  abort,  significant  delay,  or  other 
degradation  occurred.  An  abort  resulted  in  mission  termination. 

A  significant  delay  occurred  when  a  problem  developed  which 
reduced  available  on-station  tow  time  by  more  than  25  percent  over 
that  planned  to  be  available.  An  "other  degradation"  occurred 
when  rotor  downwash  or  noise  resulted  in  equipment  damage  or 
personnel  injury,  but  did  not  result  in  a  significant  delay. 
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Compatibility  problems  with  the  tested  AMCM  devices  were 
documented,  but  not  all  AMCM  device  configurations  were  tested. 

The  sample  size  of  AMCM  events  was  not  large,  and  further  testing 
is  required  to  define  the  full  effect  of  rotor  wash  and  noise  on 
the  MH-53E  and  its  resultant  hazardous  conditions  to  personnel  to 
see  how  effectively  each  AMCM  device  can  be  employed. 

Interim  Navy  operational  restrictions  due  to  a  previously 
identified  and  uncorrected  OPEVAL  deficiency  (recoverability  with 
a  single  engine  failure  under  tow)  limited  beginning  fuel  weight 
and,  in  turn,  decreased  available  AMCM  on-station  time. 
Recoverability  with  a  single  engine  failure  is  an  inherent  problem 
for  all  helicopters  involved  in  the  AMCM  mission  due  to  extended 
flight  operations  at  low  altitude  and  low  airspeed,  in  particular 
while  towing.  The  MH-53E's  capability  to  recover  from  a  single 
engine  failure  is  reduced  because  the  increased  fuel  capacity  is 
achieved  through  enlarged  fuel  sponsons  which  cannot  be 
jettisoned.  The  fuel  weight  limit  was  defined  as  that  necessary 
to  give  the  MH-53E  a  dual  engine  hover  in  ground  effect  capability 
before  AMCM  stream  and  tow  could  commence.  It  was  applicable  to 
routine  or  training  AMCM  missions  and  was  intended  to  increase 
aircraft  survivability  during  AMCM  operations  in  the  event  of  an 
engine  failure.  Its  effect  on  mission  effectiveness  is  to 
significantly  reduce  or  eliminate  tow  time  with  some  AMCM 
configurations  in  warm  climates,  which  is  incompatible  with 
mission  requirements. 

Salt  spray  ingestion  caused  by  rotor  downwash  during  tow, 
which  caused  an  unacceptable  loss  of  engine  power,  was  an 
uncorrected  deficiency  from  OPEVAL.  No  power  losses  were  observed 
during  tow,  although  the  downwash  did  cause  salt  spray  clouds  to 
form.  Power  degradation  was  observed  during  hover  in-flight 
refueling. 

Excessive  noise  levels  which  degraded  aircrew  communications 
was  also  an  uncorrected  OPEVAL  deficiency.  The  problems  caused  by 
this  noise  were  discussed  earlier  in  the  section  on  operational 
effectiveness . 

Operational  suitability  was  assessed  with  regard  to 
interoperability  or  the  adequacy  of  the  interface  between  the 
MH-53E  and  the  subsystems  with  which  it  must  operate.  Evidence  of 
interoperability  problems,  which  did  or  could  potentially  degrade 
mission  effectiveness,  were  noted  as  aircrew  members  and 
maintenance  personnel  qualitatively  documented. interoperability 
deficiencies  on  questionnaires. 
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As  previously  discussed,  these  interface  problems  concerned 
oscillations  of  AMCM  devices,  device  assembly  strikes  on 
the  airframe,  unseated  cables,  and  damage  to  the  devices.  These 
observed  problems  may  be  mitigated  by  new  AMCM/MH-53E  procedures 
and  aircraft  maneuver  techniques  which  are  being  developed  as  the 
aircraft  matures. 

Restrictions  on  shipboard  operations  were  identified  during 
OPEVAL  as  a  major  interoperability  issue.  In  general,  elevator 
use,  hangar  deck  parking,  and  flight  deck  spot  became  more 
restricted  as  the  ship  size  became  smaller  and  may  affect  aircraft 
maintainability  and  availability.  No  shipboard  operations  were 
conducted  during  FOT&E.  Further  testing  is  scheduled  in  FY89  and 
FY90 . 


Training  was  assessed  continuously  during  project 
operations.  Aircrew  and  maintenance/support  personnel  provided 
qualitative  comments  on  the  training  they  had  received.  Problems 
were  noted,  including  the  fact  that  the  use  of  the  RH-53D  to 
supplement  MH-53E  AMCM  tow  training  did  not  fulfill  MH-53E 
requirements  due  to  substantial  differences  between  the  airframes. 

Human  factors  were  assessed  as  test  participants 
qualitatively  recorded  their  observations  of  MH-53E  human  factors 
features  in  questionnaires.  It  was  determined  that  certain 
cockpit  gauges,  status  lights,  and  indicators  did  not  meet  the 
requirements  necessary  for  pilots  and  copilots  to  conduct  their 
job  assignments  effectively.  The  cabin  area  in  AMCM-conf igured 
aircraft  contained  features  which  unnecessarily  inhibited  aircrew 
movement,  interfered  with  job  assignments,  or  created  potential 
hazards  from  flying  objects.  Many  maintenance  and  aircrew  tasks 
were  inordinately  difficult  to  perform.  Also,  the  AFCS  coupler 
did  not  provide  the  designed  features  under  certain  environmental 
conditions.  This  problem  increased  the  amount  of  human 
interaction  required  to  fly  the  aircraft. 

The  adequacy  of  MH-53E  safety  features  was  qualitatively 
assessed  and  recorded  continuously  throughout  the  test  period. 
Operations  were  halted  when  any  unsafe  or  potentially  unsafe 
condition  was  encountered  by  test  participants.  Aircrews  and 
maintenance  personnel  reported  41  specific  safety  hazards  in  which 
personnel  injury  or  aircraft  damage  occurred,  or  was  believed 
highly  likely  to  occur.  These  assessments  were  made  based  on  the 
situation,  system  knowledge,  and  their  experience. 

Six  major  safety  deficiencies  were  noted,  which  included 
hazards  to  aircrew  and  equipment  due  to  poor  compatibility  and 
interoperability  of  AMCM  equipment,  deficiencies  which  aggravated 
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the  potential  for  injury  due  to  a  fall,  emergency  egress 
deficiencies,  an  aircraft  environmental  control  deficiency,  fuel 
system  design  deficiencies  which  presented  hazards,  and  hazards 
from  high ' aircraft  noise  levels  in  the  tow  environment. 

Additionally,  the  survivability  of  the  MH-53E  in  case  of  a 
single  engine  failure  under  tow  remained  an  uncorrected  safety 
deficiency.  Interim  provisions  restricted  the  aircraft  to 
conducting  routine  and  training  tow  missions  at  two-engine  hover 
in  ground  effect  gross  weight.  This  required  reducing  fuel  on 
board  and  decreased  the  flight  time  available  to  conduct  towing. 
The  reduced  aircraft  weight  improved  aircraft  survivability  by 
effectively  increasing  fly-out  capability  of  the  aircraft  with  the 
two  remaining  engines . 

Documentation  was  assessed  for  adequacy  and  accuracy 
continuously  during  project  operations.  Some  maintenance 
publication  work  packages  and  the  MCM  configuration  publication 
v»ere  not.  available.  Other  publications  contained  numerous  errors. 

In  summary,  the  operational  effectiveness  of  the  MH-53E  was 
significantly  affected  by  major  limitations  to  test  regarding 
compatioility,  and  observed  operational  effectiveness  was 
marginal.  Nine  of  9  suitability  issues  were  evaluated  as 
unsatisfactory,  and  another,  availability,  was  not  tested  because 
corrections  were  not  in  place.  The  MH-53E  is  not  operationally 
suitable. 
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CONCLUSIONS 

Follow-on  operational  test  and  evaluation  of  the  MH-53E  in 
its  primary  mission  was  conducted  in  a  constrained  manner  due  to 
the  severe  limitations  imposed  by  compatibility  and 
interoperability  problems  observed  in  earlier  testing.  Earlier 
testing  had  identified  major  problems  which  required  long-term 
resolution,  including  the  need  for  an  engine  upgrade, 
modifications  for  an  active  noise  reduction  system  in  the 
intercommunications  system,  and  improvements  to  the  tension-skew 
indicator  and  rotor  bearings. 

Interim  solutions  anticipated  for  all  of  these  problems  did 
not  operate  satisfactorily  or  were  not  yet  available  for  test.  In 
addition,  the  mission  navigation  system  needed  for  effective  AMCM 
operations  experienced  numerous  and  continual  failures. 

The  limitations  to  test  and  the  results  observed  in  FOT&E 
lead  to  the  conclusion  that  the  MH-53E,  as  tested,  is  marginally 
effective  in  its  primary  mission  of  AMCM  and  is  not  operationally 
suitable.  Although  the  MH-53E  demonstrated  successful  AMCM  tow 
capability  once  the  mine  countermeasures  gear  was  streamed,  the 
integrated  weapon  system  is  only  marginally  operationally 
effective  for  the  conduct  of  the  primary  AMCM  mission  until  the 
add-on  navigation  system  capability  is  improved  or  replaced  and 
the  major  suitability  issues  of  reliability,  maintainability, 
compatibility,  interoperability,  safety,  and  human  factors  are 
further  examined  and  resolved  in  future  testing. 

The  solutions  to  several  of  these  issues  are  considered  to  be 
long-term  and  will  be  given  continued  close  attention  by  DOT&E . 
Recent  positive  actions  have  been  taken  by  the  Navy  to  correct 
some  of  the  deficiencies  through  procedural  and  hardware  changes. 
The  procedural  changes  observed  by  DOT&E  appear  effective.  These 
procedural  changes,  planned  hardware  changes,  and  the  inherent 
capability  of  the  MH-53E  clearly  indicate  a  potential  for 
satisfactory  effectiveness  and  suitability  in  the  AMCM  mission. 
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OPERATIONAL  TEST  AND  EVALUATION  REPORT 

ON  THE 

SECURE  TELEPHONE  UNIT  -  THIRD  GENERATION  (STU-III) 


The  Office  of  the  Director,  Operational  Test  and  Evaluation 
has  completed  its  assessment  of  the  STU-III  Low  Cost  Terminal  - 
Type  I  (STU-III/LCT-I ) .  This  report  is  being  submitted  in 
fulfillment  of  the  provisions  of  10  U.S.C.  138. 

The  operational  test  and  evaluation  of  the  STU-III  was 
limited  but  adequate  to  assess  the  operational  effectiveness  and 
suitability  of  the  STU-III/LCT-I  in  operational  facilities.  The 
testing  was  conducted  in  as  realistic  an  environment  as  could  be 
achieved  within  the  limitations  on  the  total  system  maturity  and 
the  equipments  made  available  for  test. 

As  tested,  the  STU-III/LCT-I  demonstrated  a  marginal 
capability  to  conduct  secure  and  plain  old  telephone  system 
(POTS)  operations.  The  marginal  rating  is  based  on  two  equipment 
problems  (terminal  lock-up  and  zeroization)  and  lack  of  full 
operations  with  the  Key  Management  System  (KMS).  The  secure 
voice  quality  did  not  meet  all  user  criteria,  but  quality  was 
subjectively  assessed  as  an  improvement  over  current  narrowband 
secure  voice  systems. 

The  STU-III/LCT-I  demonstrated  marginal  ability  to  meet 
operational  suitability  criteria.  The  marginal  rating  is  based 
on  three  deficiencies  (training  and  manuals,  logistics  support, 
and  lack  of  procedures  for  local  issue  and  control  of  terminals 
and  keying  material). 

The  National  Security  Agency  indicates  the  vendors  have 
taken  action  to  correct  lock-up,  zeroization,  and  manuals.  They 
also  plan  to  improve  secure  voice  quality  in  future  equipments 
by  incorporation  of  higher  data  rate  voice  techniques.  An 
overall  assessment  is  that  the  STU-III/LCT-I  has  strong  potential 
to  be  an  operationally  effective  and  suitable  system  after 
completion  of  the  deficiency  corrections  and  incorporation  of 
enhancements . 

A  description  of  the  STU-III  and  the  adequacy  of  the  tests 
conducted,  together  with  amplifying  information  on  operational 
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SYSTEM  DESCRIPTION 

The  Future  Secure  Voice  System  (FSVS)  program  was  initiated 
by  the  National  Security  Agency  to  significantly  enhance  the 
security  of  U.S.  telephone  communications.  The  FSVS  consists  of 
various  types  of  STU  terminals  and  Key  Management  System  (KMS) 
elements.  FSVS  terminal  types  are  the  STU-III/LCT,  offered  in 
Type  I  and  Type  II  versions  (described  below);  STU-I I I /Cellular, 
to  provide  secure  cellular  radio  telephones;  the  Automatic 
Remote  STU  (ARSTU)  to  provide  a  red  switch  interface;  the 
STU-I I IA,  a  STU- I I  compatible  version;  and  the  STU-III/MPT,  a 
mobile  version  ruggedized  for  aircraft  and  mobile  platforms. 

The  KMS  includes  the  Key  Management  Center  (KMC)  and  Key 
Material  Ordering  and  Distribution  Centers  ( KMODC ) .  A  Rekey 
Simulator  (RKS)  is  available  and  was  used  for  test  purposes 
during  the  operational  test  and  evaluation. 

The  hub  of  the  KMS  is  the  key  management  center  (KMC)  for 
the  National  Security  Agency  and  the  communications  security 
(COMSEC)  custodians  or  other  personnel  responsible  for  local 
issue  and  control  of  terminals  and  keying  materials  for  users. 
For  Type  I  terminals,  two  keying  options  are  available  (seed  key 
and  operational  key) .  Either  of  the  two  keying  options  can  be 
loaded  into  an  EEPROM  embedded  in  a  plastic  material  that  is 
shaped  like  a  car  ignition  key  and  nomenclatured  KSD-64A.  The 
user's  terminal  is  keyed  by  proper  use  of  the  KSD-64A  which  has 
been  loaded  with  keying  material  for  transfer  to  the  terminal. 
The  KSD-64A  becomes  the  crypto  ignition  key  (CIK)  for  the 
terminal  after  transfer  of  the  keying  material.  Rekeying 
requires  interaction  with  the  KMS  and/or  local  COMSEC  custodian. 

Type  I  terminals  offer  full  security  up  to  and  including  Top 
Secret  and  compartmented  levels.  Type  II  terminals  are  intended 
for  the  protection  of  unclassified  national  security-related 
traffic  and  privacy  and  are  interoperable  with  Type  I. 

STU-III/LCT- I  is  a  microprocessor-based  secure  voice/data 
terminal  being  developed  and  manufactured  by  three  vendors: 

AT&T,  Motorola,  and  RCA.  These  equipments  are  interoperable  and 
can  operate  as  a  Plain  Old  Telephone  System  (POTS)  for  unsecured 
analog  transmission.  Proper  use  of  a  KSD-64A/CIK  enables  the 
terminals  to  achieve  secure  voice  or  data  operation  at  2.4 
Kilobits  per  second  (Kbps)  using  a  linear  predictive  coding 
(LPC)  voice  algorithm  designated  the  LPCIOe.  The  AT&T  terminals 
can  operate  at  4.8  Kbps  in  secure  voice  or  data  modes  when 
communicating  with  another  AT&T  terminal.  The  National  Security 
Agency  indicates  that  future  enhancements  include  the 
requirement  for  all  terminals  to  include  4.8  Kbps  capability, 
and  that  Motorola  plans  to  include  a  9.6  Kbps  rate  capability  in 
1989.  Terminal  data  rate  is  related  to  data  transmission 
capability  and  the  efforts  to  improve  secure  voice  quality. 
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TESTING  ADEQUACY 


The  independent  field  phase  of  STU-III/LCT-I  operational 
test  and  evaluation  of  the  STU-III  was  conducted  by  the  Air 
Force  Communi  cat  ions  Command  (AFCC),  181.5th  Operational  Test  and 
Evaluation  Squadron  (OTES)  at  24  sites  throughout  the  Pacific 
and  the  CONUS  during  the  period  18  April  1988  to  16  June  1988. 
Operational  test  and  evaluation  was  conducted  in  accordance  with 
the  approved  Qualification  Operational  Test  and  Evaluation 
( QOT&E )  plan.  The  1815th  OTES  prepared  an  interim  test  report 
dated  August  1988  which  was  released  to  Headquarters  Air  Force 
by  AFCC  on  09  September  1988.  The  Air  Force  Operational  Test 
and  Evaluation  Center  (AFOTEC)  monitored  the  QOT&E  and  reported 
concurrence  with  the  overall  conclusions  of  the  QOT&E  report  on 
21  September  1988  to  Headquarters  Air  Force.  The  reports  have 
been  reviewed  by  the  National  Security  Agency. 

The  National  Security  Agency  established  a  test  program  for 
the  STU-III/LCT  to  implement  the  16  September  1985  guidance  of 
the  Secretary  of  Defense:  "Instead  of  the  traditional  and 
extensive  cycle  of  Service  developmental/operational  testing  and 
evaluation,  the  Director,  NSA  shall  conduct  an  accelerated  test 
program  of  the  STU-III  equipments."  This  guidance  reflects  the 
competitive,  market-driven  nature  of  the  program  with  its  unique 
acquisition  strategy,  and  the  fact  that  it  was  not  structured  as 
a  traditional  requirements -driven  development.  It  resulted  in  a 
testing  strategy  which  was  more  concentrated  and  streamlined  in 
nature  than  the  typical,  traditional  testing  efforts.  The 
National  Security  Agency  strategy  included  four  phases  of 
testing  to  include  vendor  acceptance  testing,  system  integration 
at  the  FSVS  interoperability  test  bed,  field  testing, 
and  a  market  determination/user  acceptance  phase.  The  strategy 
did  not,  however,  include  adequate  independent  operational  test 
and  evaluation  in  accordance  with  10  U.S.C.  138.  The  National 
Security  Agency  reported  results  of  their  four  test  phases,  data 
from  the  various  Service  and  Agency  activities,  and  other 
related  testing  in  a  report  dated  15  August  1988. 

The  Director,  Operational  Test  and  Evaluation  designated  the 
FSVS/STU-III  program  for  test  and  evaluation  oversight  in  April 
1986  and  began  efforts  to  increase  the  use  of  independent  test 
agents  for  operational  test  and  evaluation.  This  effort  led  to 
the  submission  of  a  National  Security  Agency  Test  and  Evaluation 
Master  Plan  (TEMP)  which  also  included  an  Air  Force  TEMP  and  the 
1815th  QOT&E  plan.  The  Director,  Operational  Test  and  Evaluation 
also  worked  with  the  independent  operational  test  agents  of  the 
Army  and  Navy  to  obtain  their  approvals  in  February  1988  of  the 
combined  operational  testing  as  structured  by  NSA  and  the  Air 
Force  in  their  TEMPs  and  the  more  detailed  1815th  QOT&E  plan. 
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Independent  operational  testing,  although  limited,  was 
adequate  to  assess  the  operational  effectiveness  and  suitability 
of  the  STU-IIX/LCT-I .  Follow-on  operational  test  and  evaluation 
is  required  to  confirm  correction  of  deficiencies  which  resulted 
in  the  marginal  ratings,  to  assess  enhancements,  and  to  assess 
all  emerging  FSVS  terminals  with  the  KMS  and  COMSEC  custodians. 

Limitations  included  the  maturity  of  the  terminals  and  key 
management  system  which  was  reflected  in  the  terminal  lock-up 
and  zeroization.  A  full  operational  KMS  with  involvement  of 
local  COMSEC  custodians  who  will  process  and  control  terminals 
and  keying  material  is  required  to  realistically  assess  field 
system  operation,  Multi-Service  and  Agency  COMSEC  material 
handling  aspects  and  logistics  support  plans  were  not  evaluated 
under  operational  conditions.  Use  of  contractor  personnel  needs 
to  be  clarified.  These  limitations  do  not  invalidate  the  test 
results,  but  will  require  resolution  in  the  planning  and 
approval  of  follow-on  operational  test  and  evaluation. 

During  the  Air  Force  OT&E  Testing,  calls  were  placed  from 
the  following  sites: 


Pacific  Test  Sites: 


Andersen  AFB  Guam 

18  April 

88 

- 

29  April 

88 

Hickam  AFB  HI 

18  April 

88 

- 

24  June 

88 

Det  1  SPCM  Maui  HI 

18  April 

88 

- 

29  April 

88 

Yokota  AB  Japan 

2  May 

88 

- 

13  May 

88 

Misawa  AB  Japan 

2  May 

88 

- 

13  May 

88 

Woomera  Australia 

2  May 

88 

— 

13  May 

68 

Kadena  AB  Japan 

16  May 

88 

- 

29  May 

88 

Clark  AB  RP 

16  May 

88 

— 

29  May 

88 

San  Miguel  RP 

16  May 

88 

- 

29  May 

88 

Osan  AB  Korea 

30  May 

88 

— 

10  June 

88 

Taegu  AB  Korea 

30  May 

88 

- 

10  June 

88 

Elmendorf  AFB  AK 

30  May 

88 

- 

3  June 

88 

Shemya  AFB  AK 

6  June 

88 

10  June 

88 

CONUS  Test  Sites : 

Langley  AFB  VA 

18  April 

88 

— 

24  June 

88 

Mather  AFB  CA 

18  April 

88 

.. 

24  June 

88 

George  AFB  CA 

18  April 

88 

- 

22  April 

88 

Hanscom  AFB  MA 

6  June 

88 

— 

10  June 

88 

Peterson  AFB  CO 

2  May 

88 

- 

6  May 

88 

Kirtland  AFB  NM 

25  April 

88 

- 

29  April 

88 

Scott  AFB  IL 

16  May  88 

- 

20  May 

88 

Hurlburt  AFB  FL 

23  May 

88 

— 

27  May 

88 

Offutt  AFB  NE 

9  May  88 

— 

13  May 

88 

Director,  Operational  Test  and  Evaluation  support  contractor 
personnel  observed  testing  at  selected  sites.  A  staff  member  of 
the  Director,  Operational  Test  and  Evaluation  observed  the  KMC 
operations  and  visited  AF<jjj^j^^<5f£|pgt  sites  during  testing. 
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OPERATIONAL  EFFECTIVENESS 


The  QOT&E  phase  of  independent  operational  test  and 
evaluation  was  a  test  of  production  representative  STU-III/LCT-I 
terminals  that  were  operated  by  1815th  OTES  personnel  at  selected 
sites  throughout  the  Pacific  and  CONUS.  The  terminals  were 
operated  over  representative  telephone  circuits  in  order  to 
evaluate  the  terminal  operational  effectiveness.  Operational 
missions  were  not  employed  and  technical  testing  techniques  were 
employed  to  quantify  performance  such  as  voice  quality. 

The  1815th  QOT&E  report  summarizes  operational  effectiveness 
as  marginal  based  on  the  systems  tested.  Voice  quality  in  secure 
voice  tests  did  not  meet  user  requirements  to  compare  with  the 
quality  of  plain  old  telephone  system  (POTS)  voice.  Subjective 
assessments  were  that  the  secure  voice  quality  is  improved  over 
current  narrowband  secure  voice  systems."  Terminal  lock-up  and 
zeroization  were  two  equipment  problems  noted.  The  National 
Security  Agency  indicates  that  they  are  planning  to  incorporate 
an  interoperable  higher  data  rate  (4.8  Kbps)  in  all  terminals 
and  that  Motorola  plans  a  9.6  Kbps  rate.  They  also  indicate 
that  the  lock-up  and  zeroization  problems  are  corrected  in  later 
terminals  which  can  be  tested  in  planned  European  testing. 

A  discussion  of  the  1815th  OTES  report  on  operational 
effectiveness  issues  follows  with  the  Director,  Operational  Test 
and  Evaluation  assessments. 

Effectiveness  Objective  E-l  evaluates  the  capability  of  the 
STU-III  terminals  to  operate  over  government-owned,  leased,  and 
commercial  switched  telephone  networks  as  well  as  the  existing 
unsecure  telephone  equipment. 

The  QOT&E  rated  this  area  as  marginal  for  Subobjectives 
E-l. 5  and  E-l. 7  concerning  operations  in  the  secure  mode  over 
DCS  and  commercial  switched  telephone  circuits.  The  threshold 
score  of  91%  using  the  Modified  Rhyme  Test  (MRT)  was  not  met. 

AT&T  achieved  86%  accuracy.  Motorola  82%  accuracy,  and  RCA  88% 
accuracy  in  the  2.4  Kbps  mode  over  the  DCS.  The  accuracy  over 
commercial  switched  telephone  circuits  was  85%  for  AT&T,  82%  for 
Motorola,  and  88%  for  RCA.  Each  terminal  met  or  exceeded  the 
91%  figure  for  POTS  operations.  The  QOT&E  requirement  was  based 
on  MIL  Standard  1472C,  and  a  user  requirement  for  91%  MRT  over 
operational  media.  The  National  Security  Agency  refers  to 
back-to-back  laboratory  scores  of  88  voice  intelligibility  in 
accordance  with  the  DoD  Diagnostic  Rhyme  Test  ( DRT ) .  The 
Director,  Operational  Test  and  Evaluation  assessment  is  that 
STU-III/LCT-I  secure  voice  quality  is  marginal  in  the  2.4  Kbps 
back-to-back  mode  and  does  not  improve  by  use  of  operational 
communications  media.  The  AT&T  4.8  Kbps  secure  voice  did 
subjectively  improve  voice  quality  in  back-to-back  operations 
but  is  not  confirmed  by  QOT&E  operational  data. 
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Effectiveness  Objective  E-3  evaluates  the  methods  of  keying 
or  rekeying  the  STU-III.  The  QOT&E  rating  of  satisfactory  is  in 
consideration  of  the  subobjective  E-3. 4  rating  of  unsatisfactory 
for  evaluation  of  the  established  procedures  for  issuing  and 
controlling  operational  keys.  The  test  director  reviewed  local 
procedures  for  issuing  and  controlling  operational  keys. 

Results  are  that  half  of  the  test  sites  had  no  information  or 
instructions  for  the  STU-III/LCT-I .  The  Director,  Operational 
Test  and  Evaluation  assessment  is  that  this  is  a  limitation  of 
the  operational  testing  to  date,  and  operation  of  the  KMS  with 
interaction  at  the  local  COMSEC  custodian  for  issue,  control, 
and  operational  use  of  the  terminals  and  keying  material  system 
should  be  confirmed  in  follow-on  operational  test  and  evaluation. 

Service  reports  were  also  prepared  to  identify  terminal 
malfunctions,  deficiencies,  and  shortfalls.  Twenty-five  were 
submitted  during  QOT&E.  Eleven  were  rated  mission  essential  and 
involved  two  equipment  problems  of  system  lock-up  and  system 
zeroization.  During  lock-up,  the  terminal  was  not  usable  as  a 
POTS  or  a  secure  terminal  until  the  power  was  removed  and 
reapplied.  The  RCA  terminals  locked-up  four  times  and  the  AT&T 
terminals  twice.  Terminals  zeroized  overnight  and  prevented 
their  use  as  secure  terminals  until  receipt  of  new  keying 
material.  The  AT&T  and  Motorola  terminals  zeroized  twice  and 
the  RCA  terminal  once.  The  National  Security  Agency  indicates 
that  all  vendors  have  corrected  these  two  problems  by  changes  in 
software  which  is  available  in  terminals  scheduled  for  European 
tests  which  started  26  September  1988.  The  Director,  Operational 
Test  and  Evaluation  assessment  is  that  the  vendor  changes  should 
be  evaluated  by  the  1815th  OTES  during  the  European  tests  and 
results  included  in  the  report  of  these  test  results. 

The  subojectives  for  E-l  evaluation  of  the  capability  to 
operate  as  well  as  an  existing  unsecure  telephone  equipment  were 
rated  satisfactory  for  E-l.l,  voice  operations  in  POTS  mode  over 
the  DCS;  E-l. 3,  voice  operations  in  POTS  mode  over  commercial 
switched  networks;  E-l. 6,  data  in  secure  mode  over  the  DCS;  and, 
E-l. 8,  data  in  secure  mode  over  commercial  switched  networks. 

AT&T  terminals  added  the  capability  to  pass  plain  text  data  over 
the  DCS  and  commercial  switched  networks,  E-l  2  and  E-l. 4. 

Establishment  of  secure  communications  within  the  required 
time  was  satisfactory  (E-2). 

Subobjectives  under  E-3  evaluation  of  the  methods  of  keying 
or  rekeying  were  rated  satisfactory  for  manual  keying  (E-3.1); 
for  electronic  keying,  which  impressed  everyone  who  observed  the 
rekey  effort  (E-3. 2);  and,  duplication  of  CIKs  up  to  the  maximum 
allowed  (E-3 .3) . 
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Objective  E-4  evaluated  the  security  protection  of  all 
terminals  as  satisfactory  by  demonstrations  of  automatically 
downgrading,  to  the  highest  common  authorized  security 
classification,  notification  to  the  user  of  lowered  common 
security  classification,  and  capability  to  deny  access  to  CIKs 
that  have  been  identified  as  compromised. 

Objective  E-5  evaluated  the  Motorola  terminal  satisfactory 
for  reversion  to  POTS  operation  without  external  power.  AT&T 
and  RCA  terminals  did  not  provide  this  capability.  The  National 
Security  Agency  indicates  that  AT&T  and  RCA  will  provide  this 
capability  in  future  terminals. 

Objectives  for  operation  in  airborne  applications  was  not 
determined,  but  will  be  conducted  and  reported  later.  Objectives 
for  operations  in  tactical  applications  were  not  determined,  but 
have  been  assessed  and  reported  as  feasible  for  the  2.4  Kbps  data 
rates  by  the  Joint  Tactical  Command,  Control,  and  Communications 
Agency  ( JTC3A)  based  on  technical  testing  through  July  1988  at 
Ft.  Huachuca,  Arizona. 

Subjective  comments  and  observations  by  QOT&E  personnel  were 
provided  on  special  features  or  options  of  the  various  terminals. 
The  AT&T  terminal  provided  4.8  Kbps  operation  with  another  AT&T 
terminal.  It  also  provided  frequency  offset,  which  was  used  in 
Korea  to  compensate  for  poor  quality  lines.  In  addition,  the 
AT&T  terminal  provided  Hayes  compatible  commands  for  operation 
of  the  internal  modem.  The  Motorola  terminal  was  most  compact, 
offered  POTS  operation  without  power,  and  had  one-button  for 
transferring  to  the  half-duplex  operation.  The  RCA  terminal 
incorporated  the  overseas  requirements  in  CONUS  terminals  and 
had  simultaneous  two/four  wire  operation  capability. 

The  Director,  Operational  Test  and  Evaluation  overall 
assessment  of  operational  effectiveness  is  marginal  for  the  FSVS 
as  tested,  including  the  test  planning  and  conduct  of  tests  with 
the  KMS  and  STU-III/LCT-I  terminals.  Marginal  implies  less  than 
satisfactory  but  not  unsatisfactory;  the  equipment  demonstrates 
capability  and  can  be  used,  but  it  needs  improvement. 

The  test  planning  has  improved  in  the  last  year  but  requires 
continued  attention  to  complete  plans  for  the  required  follow-on 
operational  test  and  evaluation  of  the  corrections  for 
deficiencies  noted  during  QOT&E  and  confirmation  of  operational 
effectiveness  of  enhancements  and  emerging  STU-III  components  in 
the  FSVS  program.  KMS  operation,  to  include  the  COMSEC  custodian 
personnel,  and  improved  voice  quality  are  critical  operational 
effectiveness  issues  for  resolution  in  the  follow-on  operational 
test  and  evaluation.  Although  limited,  the  QOT&E  and  National 
Security  Agency  test  results  confirm  that  the  STU-III/LCT-I  has 
strong  potential  to  be  operationally  effective  for  POTS  and 
secure  voice  communications. 
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OPERATIONAL  SUITABILITY 


The  QOT&E  phase  of  independent  operational  test  and 
evaluation  vas  a  test  of  production  representative  STU-III/LCT-I 
terminals  that  were  operated  by  1815th  OTES  personnel  at  selected 
sites  throughout  the  Pacific  and  CONUS.  The  terminals  were 
operated  over  representative  telephone  circuits  in  order  to 
evaluate  the  terminal  operational  effectiveness.  Operational 
missions  were  not  employed  and  technical  testing  techniques  were 
employed  to  quantify  performance  such  as  voice  quality.  The 
logistics  supply  capability  was  not  in  place  and  contractor 
personnel  were  utilized  for  repair  and  trouble  shooting  as 
required  in  order  to  complete  the  test.  Final  plans  have  not 
been  made  for  use  of  contractor  maintenance  or  warranties. 

The  1815th  QOT&E  report  summarizes  operational  suitability 
as  marginal  based  on  the  systems  tested.  The  suitability  of 
life-cycle  support  channels  to  support  operational  requirements 
was  undetermined.  Operational  Suitability  in  the  Air  Force  test 
report  was  rated  marginal .  The  assessment  was  based  upon 
comments  from  participants  in  the  OT&E  process  and  observations 
of  members  of  the  1815th  OTES  conducting  the  Air  Force  test. 

The  National  Security  Agency  report  did  not  cover  total  user 
system  suitability  issues,  but  did  discuss  those  related  to  the 
STU-III/LCT-I  terminal  which  they  developed  and  procured. 

The  1815th  report  on  operational  suitability  issues  follows 
with  the  Director,  Operational  Test  and  Evaluation  assessments. 

Suitability  Objective  S-l  assesses  the  suitability  of 
life-cycle  support  channels  to  support  operational  requirements. 

The  Air  Force  rated  this  area  as  undetermined.  Although 
there  were  no  provisions  for  life-cycle  support  in  place  for  the 
QOT&E,  the  vendors  provided  replacement  terminals  when 
notified.  They  provided  a  toll-free  phone  number  for  service 
information  to  CONUS  test  personnel.  This  toll-free  phone 
service  was  not  available  to  the  test  directors  overseas. 

Suitability  Objective  S-3  assesses  the  suitability  of  user 
manuals.  Suitability  Objective  S-5  assesses  the  suitability  of 
training  for  the  STU-III. 

The  QOT&E  rated  these  areas  as  marginal  for  manuals  and 
unsatisfactory  for  training.  The  training  assessment  is  related 
to  the  manuals  in  that  some  users  had  problems  in  configuring 
the  terminals  due  to  the  readability  problems  with  some  of  the 
manuals.  The  National  Security  Agency  reports  that  revised 
manuals  are  being  prepared.  The  Director,  Operational  Test  and 
Evaluation  assessment  is  that  training  is  one  of  the  areas  which 
needs  to  be  resolved  by  Service  and  Agency  approval  of  their 
maintenance  plans.  Follow-on  operational  test  and  evaluation  is 
required  to  confirm  operational  suitability. 
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Suitability  Objective  S-6  assesses  the  established 
procedures  to  issue  and  control  STU-III  terminals.  This 
objective  is  related  to  Effectiveness  Subobjective  E-3.4  for 
established'  procedures  for  issuing  and  controlling  of 
operational  keys. 

The  QOT&E  rating  for  S-6  is  marginal  based  on  a  review  of 
current  procedures  to  issue  and  control  the  STU-III/LCT-I 
terminals.  The  E-3.4  rating  was  unsatisfactory  for  established 
procedures  for  issuing  and  controlling  of  operational  keys.  The 
Director,  Operational" Test  and  Evaluation  assessment  is  that 
this  is  a  limitation  of  the  operational  testing  to  date,  and 
operation  of  the  KMS  with  interaction  at  the  local  COMSEC 
custodian  for  issue,  control,  operational  use,  and  operational 
support  of  the  terminals  and  keying  material  system  should  be 
confirmed  in  follow-on  operational  test  and  evaluation. 

Suitability  Objective  S-13  evaluates  the  self-diagnostic 
capability  of  the  STU-III. 

The  QOT&E  rates  this  objective  as  undetermined.  Terminal 
difficulties  were  to  be  analyzed  using  self-diagnostics  of  each 
terminal.  However,  error  code  definitions  were  not  provided  by 
RCA,  and  the  AT&T  and  Motorola  code  listings  were  provided  two 
weeks  before  completion  of  the  test  but  not  evaluated.  The 
Director,  Operational  Test  and  Evaluation  assessment  is  that 
self-diagnostics  issues  need  to  be  resolved  by  Service  and 
Agency  approval  of  their  maintenance  plans  and  follow-on  testing. 

Suitability  Objective  S-8  evaluated  the  reliability  of 
STU-III  as  satisfactory  based  on  a  mean  time  between  critical 
failure  of  7000  hours  as  compared  to  a  3000-hour  requirement. 
Human  engineering,  S-ll,  was  satisfactory  and  no  special  tools 
were  required  (S-4  satisfactory).  Installation  was  satisfactory. 

The  Director,  Operational  Test  and  Evaluation  overall 
assessment  of  operational  suitability  is  marginal  for  the  FSVS 
as  tested,  including  the  test  planning  and  conduct  of  tests  with 
the  KMS  and  STU-III/LCT-I  terminals.  Marginal  implies  less  than 
satisfactory  but  not  unsatisfactory;  the  equipment  demonstrates 
capability  and  can  be  used,  but  it  needs  improvement. 

The  test  planning  has  improved  in  the  last  year  but  requires 
continued  attention  to  complete  plans  for  the  required  follow-on 
operational  test  and  evaluation  of  the  corrections  for 
deficiencies  noted  during  QOT&E  and  confirmation  of  operational 
suitability  of  enhancements  and  emerging  STU-III  components  in 
the  FSVS  program.  KMS  operation  to  include  COMSEC  custodian 
personnel  and  improved  planning  for  life-cycle  support  are 
critical  operational  suitability  issues  for  resolution  in  the 
follow-on  operational  test  and  evaluation.  Although  limited, 
QOT&E  and  National  Security  Agency  test  results  confirm  that  the 
STU-III/LCT-I  has  strong  potential  to  be  operationally  suitable 
for  POTS  and  secure  voice  communications. 
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CONCLUSION 


Independent  operational  testing,  although  limited,  was 
adequate  to  determine  operational  effectiveness  and  suitability 
as  marginal  for  the  systems  tested.  Marginal  implies  that  the 
system  is  useable  but  it  needs  improvements.  Observed  terminal 
reliability  and  useability  have  been  acceptable.  The  system  has 
strong  potential  to  be  operationally  effective  and  suitable. 

Follow-on  independent  operational  test  and  evaluation  is 
required.  Improved  interoperable  secure  voice  quality,  KMS 
operation  to  include  the  user  COMSEC  custodian  personnel,  and 
maintenance  plan  completion  and  implementation  are  critical 
issues  for  resolution  in  the  follow-on  independent  operational 
test  and  evaluation. 

The  FSVS  remains  on  the  Director,  Operational  Test  and 
Evaluation  list  of  designated  DoD  programs  for  operational  test 
and  evaluation  oversight  A  new  FSVS  TEMP  and  operational  test 
plans  are  required  to  approve  the  follow-on  operational  testing 
of  STU-III/LCT-I  and  new  emerging  components  in  the  FSVS  program. 
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OFFICE  OF  THE  SECRETARY  OF  DEFENSE 
WASHINGTON,  D.C,  20301 


5  December  1988 


OPERATIONAL  TEST  AND  EVALUATION  REPORT 
ON  THE 

MOBILE  SUBSCRIBER  EQUIPMENT  (MSE)  SYSTEM 


The  Office  of  the  Director,  Operational  Test  and  Evaluation  has 
completed  Its  assessment  of  the  Mobile  Subscriber  Equipment  (MSE)  Follow-On 
Operational  Test  and  Evaluation  (FOT&E).  This  report  Is  being  submitted  In 
fulfillment  of  the  provisions  of  Title  1C  USC  138. 

The  FOT&E  was  adequate  to  support  an  assessment  of  MSE  effectiveness 
and  suitability  to  perform  Its  mission  of  providing  a  division-area 
communications  system  and  supporting  mobile  and  static  users  with  voice, 
data  and  facsimile  communications.  The  test  scenarios  consisted  of  both 
scripted  events  and  a  free  play  tactical  exercise  designed  to  replicate 
traffic  and  sizing  conditions  associated  with  actual  combat  and  to  address 
specific  contract  performance  requirements. 

The  MSE  system  represents  an  Innovative  approach  to  the  military 
acquisition  process  and  Is  the  first  system  to  be  procured  under  a 
streamlined  acquisition  strategy  designed  to  shorten  the  lime  normally 
required  for  acquisition.  In  a  relatively  short  period  of  time  the  MSE 
Non-Developmental  Item  (NDI)  strategy  has  fielded  a  complete  division 
set  of  equipment.  DOT&E  considers  the  operational  suitability  and 
effectiveness  of  MSE  to  be  adequate  at  this  level  of  maturity.  DOT&E  will 
Insist  the  Army  conduct  a  series  of  verification  tests  and  assessments  of 
an  operational  nature  to  ensure  that  Identified  problems  are  corrected  and 
appropriate  means  are  In  place  to  withhold  funds  If  the  corrections  are  not 
accomplished  satisfactorily.  This  process  will  ensure  that  the  Items 
delivered  are  Doth  operationally  effective  and  suitable. 

A  description  of  the  MSE  system  and  the  adequacy  of  the  testing 
conducted,  together  with  amplifying  Information  on  operational 
effectiveness  and  suitability  follows. 
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SYSTEM  DESCRIPTION 

The  Mobile  Subscriber  Equipment  <MSE)  system  Is  a  complete  tactical 
communications  system  that  Is  designed  to  satisfy  the  essential  area 
communications  at  Division  and  Corps  level  throughout  the  Army.  The 
system  has  as  Its  objective  provision  of  highly  mobile  secure  digital 
communications  capable  of  providing  users  with  voice,  data,  and  facsimile 
service.  The  system  Is  automatic,  self  organizing,  and  uses  flood  search 
routing  to  enable  subscribers  to  retain  their  telephone  number  and  enter 
the  network  regardless  of  their  location  on  the  battlefield.  MSE  Is 
Intended  to  provide  commanders  and  their  staff  with  a  much  more  mobile 
communications  capability  not  available  with  the  present  system.  Figure 
lisa  diagram  of  a  4  node  Division  deployment  scheme. 

The  system  consists  of  five  functional  areas  which  Interoperate  with 
each  other  providing  a  digital  grid  network  communications  service 
supporting  the  Corps  and  Division  areas.  A  brief  description  of  each 
functional  area  follows. 

a.  Subscriber  Terminals.  The  Subscriber  Terminal  functional 
area  provides  telephone,  data  and  facsimile  service.  The  Digital 
Non-Secure  Voice  Terminal  (DNVT)  Is  a  tactical  push-button  telephone 
which  Incorporates  a  data  port  for  connecting  either  facsimile  or  digital 
device  terminals.  The  DNVT  permits  entry  Into  the  MSE  telephone 
switching  network. 

b.  Mobile  Subscriber  Access.  The  Mobile  Subscriber  functional 
area  provides  access  to  the  MSE  telephone  switching  system  from  tactical, 
mobile,  vehicular  telephones  called  Mobile  Subscriber  Radio  Telephones 
(MSRTs) .  The  MSRT  permits  mobile  subscribers  secure  voice  or  data  access 
to  the  MSE  switching  system  throughout  the  tactical  area  of  operation. 

The  MSRT  Is  a  mobile  radio  transceiver  which  gains  access  to  the  MSE 
network  through  Radio  Access  Units  <RAUs>  which  are  connected  by  wire  or 
radio  to  the  MSE  Node  Center  Switches  (NCSs). 

c.  Wire  Subscriber  Access.  The  Wire  Subscriber  Access 
functional  area  provides  wire  telephone  subscriber  service  to  local  area 
users  using  Large  Extension  Node  (LEN)  or  Small  Extension  Node  (SEN) 
switches.  The  LENs  or  SENs  provide  long-distance  service  to  other  local 
area  switches  via  Line  of  Sight  (LOS)  radio  links  to  MSE  Node  Center 
Switches  (NCSs).  The  NCS  switches  (4  per  Division  and  42  per  Corps)  form 
the  grid  network  area  coverage  communications  system  for  the  MSE  network. 

d.  Area  Coverage.  The  Area  Coverage  functional  area  provides 
the  grid  network  communications  In  support  of  the  Division  or  Corps 
area.  The  grid  network  Is  composed  of  4  node  Center  Switches  (NCS)  per 
Division  (42  per  Corps).  Access  to  the  grid  network  Is  provided  either 
through  the  Radio  Access  Units  (RAUs)  which  support  the  mobile  telephone 
system,  or  through  the  Large/Small  Extension  Nodes  (LEN/SEN)  which 
support  the  wire  subscribers.  An  automatic  digital  network  permits 
access  to  the  MSE  network  from  anywhere  within  the  area  of  operation  from 
either  the  mobile  radios  or  the  wire  subscriber  telephones. 
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e.  System  Control.  The  System  Control  functional  area  provides 
an  automated  capability  for  system  management,  technical  support  and 
circuit/network  planning  of  the  MSE  network.  The  System  Control  Center 
<SCC)  consists  of  a  management  shelter,  a  technical  support  shelter  and  a 
planning  shelter.  At  Division  level  only  the  management  and  technical 
support  shelter  are  employed. 


FIGURE  1  -  MSE  4  Node  Division  Deployment  Scheme 
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BACKGROUND 

The  MSE  program  used  a  competitive  Non-Development  < NDI >  acquisition 
strategy  which  was  designed  to  take  advantage  of  available  technology  and 
avoided  a  lengthy  developmental  period.  In  July  1984  the  Army  released  a 
soli  citation 'package  to  Industry  which  supported  the  NDI  approach.  The 
contract  was  subsequently  awarded  to  General  Telephone  and  Electronics 
(GTE)  and  signed  In  December  1985.  The  Army  exercised  Its  Option  Year  1 
decision  coincidentally  with  its  decision  to  let  the  basic  contract. 

Option  Year  2  was  awarded  In  February  1987.  Option  Year  3  Is  preceded  by 
operational  testing  which  will  determine  the  operational  effectiveness  and 
suitability  of  the  system  and  will  be  used  to  support  approval  of  award  of 
Option  3. 

Throughout  the  program  DOT&E  has  been  actively  Involved  In  the  test 
planning  process  to  Include  review  of  the  Test  and  Evaluation  Master  Plan 
(TEMP),  the  Test  Design  Plan  (TDP),  and  on-site  observations  of  the 
preparatory  testing  accomplished  at  the  contractor's  facilities  and  at  Ft. 
Hood,  Texas.  DOT&E  also  attended  numerous  test  planning  meetings  and 
conducted  on-site  observations  during  the  FOT&E.  DOT&E  required  the 
Inclusion  of  operational  testing  as  part  of  the  MSE  acquisition  strategy 
prior  to  the  execution  of  the  MSE  Option  3  award.  DOT&E 's  review  of  the 
test  plans  resulted  In  the  Inclusion  of  a  limited  baseline  comparison  and 
a  limited  assessment  of  MSE  performance  under  EW  conditions. 


TESTING  ADEQUACY 

DOT&E  Is  satisfied  that  the  MSE  Follow-On  Operational  Test  and 
Evaluation  (FOT&E)  at  Ft.  Hood,  Texas  was  adequate  to  support  an 
assessment  of  the  system's  operational  effectiveness  and  suitability 
although  limited  by  deficiencies  outlined  below.  This  assessment  Is  based 
upon  DOT&E 's  active  Involvement  In  the  review  and  approval  of  the  Test  and 
Evaluation  Master  Plan  (TEMP)  as  well  as  other  test  planning 
documentation,  on-site  observations  of  the  preparatory  testing 
accomplished  both  at  the  contractor's  facilities  and  at  Ft.  Hood  during 
the  Destination  and  Final  Acceptance  Testing  (DFAT).  DOT&E  also  observed 
the  pre-test  training,  reviewed  the  contractor  support  plans,  conducted 
on-site  observations  during  the  FOT&E  and  conducted  an  Independent  review 
of  the  U.S.  Army  Operational  Test  and  Evaluation  Agency's  (OTEA's)  Interim 
FOT&E  Independent  Evaluation  Report  (IER).  DOT&E  attended  MSE  Quarterly 
reviews.  Test  Integration  Working  Group  (TIWG)  meetings  and  other  key  MSE 
program  meetings.  DOT&E  required  the  Inclusion  of  operational  testing  as 
part  of  the  MSE  acquisition  strategy  prior  to  the  execution  of  the  MSE 
Option  III  award.  DOT&E' s  review  of  the  test  plans  resulted  In  the 
Inclusion  of  a  limited  baseline  comparison  and  a  limited  assessment  of  the 
MSE  performance  under  EW  conditions. 

The  FOT&E  was  scheduled  to  follow  the  Army's  acceptance  of  both  the 
MSE  equipment  and  the  contractor  provided  user  training.  DOT&E  supported 
the  Inclusion  of  a  division-level  CPX  prior  to  acceptance  of  MSE  equipment 
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and  training.  Based  upon  observations  of  HSE  performance  during  the  CPX, 
DOT&E  encouraged  the  Army  to  delay  the  start  of  FOT&E  until  the  Army  was 
confident  that  the  HSE  system  could  satisfy  the  requirements.  In  May 
1988the  Army  began  combined  field  testing,  on-site  analysis,  and 
corrective  actions  to  Identify  and  correct  MSE  system  deficiencies.  After 
a  three-month  delay  and  substantial  Improvements  to  the  MSE  system,  the 
Army  conducted  the  MSE  FOT&E  from  9  August  1988  through  25  October  1988. 

The  FOT&E  was  conducted  by  the  1st  Cavalry  Division  at  Ft.  Hood  and 
the  test  consisted  of  three  phases  summarized  as  follows: 

Phase  One  (Pilot  Test)  -  This  phase  consisted  of  a  two  week  pilot  test 
designed  to  demonstrate  a  successful  test  network  and  conduct  typical 
test  scenarios  In  order  to  evaluate  the  data  collection,  processing, 
reduction  and  analyses  activities.  All  objectives  of  this  phase  were 
met. 

Phase  Two  (Record  Test)  -  This  phase  of  the  test  was  the  primary 
source  of  all  data  collected  during  FOT&E.  It  consisted  of  a  six  week 
period  during  which  a  series  of  scripted  scenarios  was  run  to  exercise 
the  communications  network  under  operationally  realistic  tactical 
loads.  Additional  scenarios  were  also  included  to  assess  the  MSE 
system  compliance  with  contract  specifications.  Side  tests  were 
conducted  to  examine  a  number  of  specific  system  features.  During 
this  phase,  traffic  loads  applied  to  the  network  resulted  In  an 
analysis  of  over  190,000  calls.  In  addition,  over  800,000  data  forms 
on  System  Performance,  Reliability,  Availability,  and  Maintainability 
(RAM),  System  Suitability  and  Manpower  and  Personnel  Integration 
(MANPRINT)  were  collected  and  analyzed. 

Phase  Three  (Command  Post  Exercise)  (CPX)  -  The  third  phase  Involved 
the  major  elements  of  the  1st  Cavalry  Division  In  a  96-hour  CPX  which 
provided  an  opportunity  to  evaluate  the  MSE  system  In  a  realistic 
free-play  environment  using  scenario  driven  live  traffic  loads. 

The  following  Is  DOT&E 's  assessment  of  the  FOT&E  test  limitations  and 
their  Impact: 

1.  Limited  hardware  availability  constrained  the  opportunities  for: 

Division-level  (4  node)  operational  testing  prior  to  an  Option  III 
contract  award;  and 

Corps-level  operational  testing  of  42  nodes  after  all  the  acquisition 
decisions  had  been  made. 

DOT&E  Insisted  that  early  operational  testing  was  critical  to  the 
successful  acquisition  of  the  MSE  system.  It  was  determined  that  a 
division-level  test  would  provide  valuable  Insights  into  system 
performance  prior  to  the  Option  III  award.  Additional  follow-on  testing 
will  be  required  to  assess  corps- level  performance. 
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2.  Computer  Models  were  to  be  used  to  predict  Corps  level  performance 
based  upon  the  FOT&E  test  results.  This  prediction  was  to  be  conducted  as 
outlined  below. 

The  computer  models  were  to  be  used  to  predict  the  operational 
performance  of  the  4  node  division  network. 

The  FOT&E  test  results  were  to  be  compared  to  predicted  MSE 
performance 

If  the  predicted  performance  was  confirmed  by  the  test  results,  the 
model  would  then  be  used  to  predict  the  42  node  corps  network. 

Suspected  software  problems  Identified  during  FOT&E  and  the  current 
status  of  the  models  do  not  support  their  use  to  predict  corps  performance 
at  this  time. 

DOT&E ’s  assessment  of  this  limitation  Is  that  extrapolation  of  model 
results  to  predict  corps-level  performance  would,  at  best,  provide  little 
to  reduce  the  risk  associated  with  an  Option  III  award.  The  problems 
Identified  during  FOT&E  must  be  corrected  and  operational  testing 
conducted  to  verify  the  corrections.  DOT&E  will  require  additional 
follow-on  testing  to  verify  corps-level  performance. 

3.  Testing  was  limited  by  weather,  the  terrain,  the  size  of  the 
deployment  area,  the  quantity  of  equipment  available  to  represent  the 
threat  and  and  FCC  frequency  restrictions.  DOT&E* s  assessment  of  the 

•  Impact  of  weather,  terrain  and  area  size  on  the  adequacy  of  the  test  and 
the  ability  to  assess  MSE  system  performance  Is  that  the  Impact  was 
minimal.  DOT&E  assessed  the  testing  of  the  threat  to  be  Inadequate. 

The  EH  test  results  are  Inconclusive  and  the  Army's  MaE  EH  Advisory 
Council  has  recommended  extensive  additional  testing.  DOT&E  considers  MSE 

•  EH  performance  to  be  a  critical  issue.  Of  the  three  major  Army 
communications  systems  (SINCGARS,  ADDS-EPLRS,  JTIDS,  AND  MSE)  only  MSE  Is 
being  procured  without  an  active  Anti-Jam  (A/J)  capability  (this  was  a 
conscious  decision  by  the  Army).  DOT&E  will  require  an  assessment  of 
MSE's  vulnerability  to  threat  Jamming. 

•  4.  The  Army  expected  problems  with  the  MSE  COMSEC  key  management  plan 
that  was  used  during  FOT&E.  One  of  the  purposes  of  the  FOT&E  was  to 
gather  data  to  assess  adequacy  of  the  COMSEC  key  management  plan  and 
recommend  modifications.  Hh lie  FOT&E  accomplished  this  task,  the  DOT&E 
assessment  Is  that  additional  operational  testing  Is  required  to  confirm 
the  adequacy  of  the  revised  COMSEC  key  management  plans. 

5.  Interoperability  testing  used  the  early  production  version  of  the 
SINCGARS  radio,  which  uses  a  separate  KY-57  COMSEC  device.  The  Integrated 
COMSEC  (ICOM)  SINCGARS  (AN/VRC-90)  radios,  the  AN/TCC-42  circuit  switch 
and  the  SB-3865  switchboard  were  not  available  for  FOT&E.  DOT&E  considers 
the  impact  of  using  the  Non-ICOM  SINCGARS  radio  to  be  minimal,  as  the 
interface  with  MSE  Is  the  same.  However,  when  these  three  systems  become 
available,  DOT&E  will  require  that  the  Interfaces  with  MSE  be  confirmed  by 
test. 
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6.  MSE-SINCGARS  co-site  Interference  testing  only  examined  the  procedures 
to  be  used  when  an  MSE  MSRT  and  SINCGARS  or  VRC-12  radio  are  co-located. 
Essentially,  these  procedures  require  that  one  system  be  turned  off  to 
preclude  co-site  Interference.  The  Army  FOT&E  Independent  Evaluation 
Report  simply  Indicates  that,  If  the  procedure  Is  followed.  It  effectively 
eliminates  co-site  Interference.  The  test  and  the  IER  do  not  address  the 
operational  Impact  of  turning  off  one  of  the  systems  or  the  advisability 
of  co-locatlng  the  two  systems  If  one  has  to  be  disabled.  DQT&E's 
assessment  Is  that  additional  operational  testing  Is  required  to  determine 
the  operational  impact  of  the  co-site  Interference  problem  In  a  nlghly 
mobile  combat  environment. 
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OPERATIONAL  EFFECTIVENESS  AND  SUITABILITY 

The  MSE  system  has  been  defined  as  an  Non-Developmental  Item  <NDI) 
acquisition.  It  Is  the  first  system  to  be  procured  under  a  streamlined 
acquisition  plan  designed  to  shorten  the  normal  acquisition  process. 
Within  three'years  the  Army  has  fielded  a  complete  division  set  of 
equipment.  While  DGT&E  Is  concerned  about  the  problems  Identified  during 
FOT&E ,  the  number  and  severity  of  the  problems  were  fewer  than  expected. 
The  DOT&E  assessment  took  into  consideration  the  magnitude  of  the  MSE 
program,  the  relatively  rapid  deployment  of  a  complete  division  set  of 
equipment  and  Its  early  exposure  to  an  operational  test. 

The  Army  assessment  has  shown  that  not  all  user  requirements  were 
met,  but  from  a  user  perspective,  the  system  Is  effective,  suitable  and 
better  than  the  current  system.  On  the  basis  of  FOT&E  results  the  Army 
has  Judged  the  system  to  be  operationally  effective  and  suitable.  DOT&E 
Is  concerned  with  MSE  performance  and  suitability  as  evidenced  by  the 
FOT&E  results.  These  test  results  and  concerns  are  outlined  In  the 
following  paragraphs. 

1.  The  Army  Identified  the  following  three  critical  operational  Issues: 

A.  CORPS-LEVEL  PERFORMANCE:  Corps-level  performance  was  not 
assessed  In  the  Army's  IER.  It  should  be  noted  that  an  FOT&E  test 
limitation  Indicated  that  limited  hardware  availability  precluded  testing 
a  corps-level  network.  DOT&E  accepted  this  test  limitation  and  accepted 
a  division-level  FOT&E  In  order  to  provide  an  early  assessment  of  the  MSE 
system  prior  to  the  award  of  Option  III.  FOT&E  resulted  In  the  early 
Identification  of  problem  areas  which  affect  both  corps  and 
division-level  performance.  While  the  TEMP  Indicated  that  computer 
models  were  to  be  used  to  extrapolate  division-level  FOT&E  results  to 
assess  MSE  performance  effectiveness  at  corps-level,  the  Army  Interim  IER 
does  not  address  the  extrapolation  of  test  data  to  assess  corps 
performance.  DOT&E  considers  that  modeling  at  best  can  only  augment 
operational  test  results.  DOT&E  will  requtre  additional  operational 
testing  of  the  MSE  system  to  determine  Its  performance  at  corps  level. 

The  FOT&E  results  reinforce  the  need  for  early  operational  testing 
and  support  the  need  for  additional  follow-on  testing  to  Include 
corps-level  to  confirm  both  the  effectiveness  of  the  corrective  actions 
resulting  from  the  FOT&E  and  to  determine  MSE's  corps-level  performance. 

The  90%  Call  Completion  Rate  (CCR)  criterion  was  not  met  In  the 
division-level  (4-node)  network  tested  during  FOT&E.  The  Grade  of 
Service  (GOS)  recorded  during  FOT&E  ranged  from  53%  to  79%.  The  Impact 
of  a  corps-level  network  on  the  GOS  Is  not  known  and  must  be  determined 
by  test  when  sufficient  hardware  Is  produced.  The  military  significance 
of  the  failure  to  meet  the  90%  criterion  cannot  be  assessed  at  this  time, 
but  a  rigorous  comparison  of  the  MSE  performance  with  the  current 
capability  under  similar  conditions  Is  not  possible  using  the  current 
FOT&E  data.  However,  the  majority  of  test  player  personnel  regarded  the 
GOS  obtained  to  be  adequate. 
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Several  of  the  system  deficiencies  Identified  during  the  FOT&E  appear 
tc  be  software  related.  The  Impact  of  these  apparent  software  problems 
on  corps-level  performance  (or  the  software  changes  required  to  correct 
these  problems)  must  be  determined.  DOT&E  will  require  operational 
evaluation  of  the  Impact  of  software  corrections. 

B.  SYSTEM  RESTORATION;  The  90%  criterion  was  met  for  restoring  an 
extension  node  within  20  minutes  when  lowering  the  antenna  mast  was  not 
required.  The  criterion  of  40  minutes  <90%  of  the  time)  when  the  mast 
was  required  to  be  lowered  was  not  met.  However,  It  was  accomplished 
within  the  time  criterion  84%  of  the  time.  The  Interim  Army  IER  contains 
no  Information  on  the  Impact  of  this  deficiency  or  the  cause  of  the 
excessive  time.  The  full  operational  Impact  of  the  failure  to  meet  the 
criterion  must  be  determined. 

C.  INTEROPERABILITY:  The  Army  reported  that  "the  crlte'la  for 
Interoperability  with  Echelons  Above  Corps  (EAC),  NATO  and  aalacent  corps 
were  not  met  while  the  criterion  for  Interoperability  with  commercial 
systems  was  met.  The  primary  cause  for  not  meeting  the  criteria  were  the 
lack  of  Interoperability  training  and  lack  of  operational  procedures. 

The  situation  was  compounded  by  the  fielding  sequence  which  provides  the 
MSE  to  divisional  units  and  the  doctrine  which  places  the  responsibility 
for  Interfacing  with  supported  divisions  on  corps  and  higher  signal 
units.  These  units  have  never  seen  nor  been  trained  on  MSE  and  were 
forced  to  experiment  on  proper  settings  and  hookups.  The  technical 
interface  between  MSE  and  other  systems  appeared  to  work." 

The  contractor  delivered  equipment  met  specifications  but,  when 
employed  In  an  operational  environment,  the  soldiers  could  not  Install 
the  required  interfaces.  The  cause  of  the  failure  was  not  the  technical 
Interface  but  rather,  insufficient  documentation  and  operator  training. 
DOT&E  will  require  test  confirmation  that  this  failure  has  been 
corrected. 

2.  With  regard  to  the  Issues  identified  by  the  Army  as  "supporting"  or 
"not  critical"  the  following  synopsis  Is  provided: 

A.  EW  PERFORMANCE:  As  noted  In  the  limitations  section.  Electronic 
Warfare  (EW)  testing  during  FOT&E  did  not  provide  sufficient  data  to 
assess  MSE  performance  under  jamming.  EW  was  an  "investigative"  Issue, 
and  the  MSE  system  was  purchased  under  an  NDI  strategy  without  an  active 
Anti-Jam  (AJ)  capability.  Clearly,  an  assessment  is  required.  This  Is 
the  only  major  communication  procurement  program  which  does  not 
Incorporate  an  active  A/J  capability.  DOT&E  will  require  further 
operational  test  and  evaluation  of  MSE  Anti-Jam  capability. 

B.  RELIABILITY:  Significant  In  the  Reliability  Availability  and 
Maintainability  (RAM)  area  are  the  FOT&E  Operational  Availability  (Ao) 
values  reported  on  the  MSF  major  assemblages.  In  all  cases  the  major  MSE 
assemblages  exceeded  the  criterion  values.  The  observed  mean  Ao  for  all 
major  assemblages  was  0.974.  While  the  operational  availability  and 
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reliability  criteria  were  satisfied  for  all  major  assemblages,  the  Large 
Extension  Node  (LEN)  was  judged  unreliable  by  the  operators  and  test 
personnel.  Frequent  system  anomalies  caused  "catastrophic"  failures 
which  required  reinitialization  of  the  major  circuit  switches.  These 
anomalies  occurred  47  times  during  FOT&E.  DOT&E  considers  the 
operational  Impact  of  these  anomalies  to  be  unacceptable.  Furthermore, 
the  Impact  of  these  failures  on  a  corps  network  of  42  nodes  must  be 
determined.  These  identified  problems  appear  to  be  Inconsistent  with  the 
system  meeting  the  criteria  for  availability  and  reliability.  The 
criterion  of  30  minutes  for  the  system's  maintainability,  as  measured  by 
the  Mean  Time  to  Repair  (MTTR)  was  not  met.  The  average  MTTR  for  all 
assemblages  was  149.25  minutes.  DOT&E  will  require  additional  follow-on 
testing  to  ensure  correction  of  these  deficiencies. 

C.  MANPRINT:  The  analysis  of  the  Manpower  and  Personnel  Integration 
(MANPRINT)  issue  Indicates  the  MSE  assemblages  generally  provide  for 
efficient  operation  and  maintenance  by  typical  soldiers  and  that  manning 
levels  are  adequate.  Training  was  considered  Inadequate.  However,  this 
deficiency  was  recognized  as  early  as  April  1988,  and  significant  changes 
have  already  been  Implemented.  DOT&E  will  require  that  corrective 
actions  on  MANPRINT  findings  be  verified  through  further  operational 
testing. 

D.  SYSTEM  MOBILITY:  The  criterion  for  30  minute  set  up  and  tear 
down  times  was  not  met.  However,  the  MSE  system  demonstrated  that  It 
could  be  set  up  and  torn  down  almost  twice  as  rapidly  as  the  current 
system.  A  comparison  of  the  MSE  system  with  the  current  system's 
Installation/Integration  times  (time  to  establish  node-to-node 
connectivity)  also  favors  the  MSE  system  by  a  wide  margin.  DOT&E 
considers  the  mobility  of  the  system  at  division  level  adequate. 

E.  MSE-MSRT  SINCGARS  CO-SITE  INTERFERENCE:  Developmental  Testing 
(DT)  Identified  significant  co-site  Interference  problems  between  the  MSE 
Mobile  Subscriber  Radio  Telephone  (MSRT)  and  the  SINCGARS  Combat  Net 
Radio  (CNR).  In  response  to  the  DT  testing  results,  operational 
procedures  were  developed  which  required  the  operator  to  turn  one  system 
off  when  using  the  other.  FOT&E  simply  confirmed  that  the  procedure  was 
effective  In  eliminating  the  co-site  problem.  It  did  not  address  the 
operational  Impact  of  turning  one  system  off  to  avoid  interference  or  the 
advisability  of  co-locatlng  two  systems  when  one  Is  required  to  be  turned 
off.  DOT&E  considers  that  co-site  testing  to  date  Indicates  a 
potentially  severe  problem  which  requires  additional  testing  to 
adequately  assess. 

F.  SYSTEM  CONTROL  CENTER  (SCC):  The  MSE  System  Control  Center 
(SCC)  was  found  to  be  of  little  use  In  Its  current  physical 
configuration,  and  Its  system  management  capability  Is  operationally 
deficient.  This  equipment  Is  used  to  manage  an  MSE  network.  Since  the 
SCC  cannot  operate  effectively  In  a  4  node  network,  DOT&E  judged  It  to  be 
of  little  assistance  In  the  control  of  a  42  node  network.  DOT&E  requires 
that  the  performance  of  the  SCC  be  further  tested  operationally  In  both 
the  division  and  corps  configurations  to  verify  that  planned 
modifications  are  effective  and  suitable. 
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CONCLUSION 

The  MSE  program  represents  an  innovative  approach  to  the  militarv 
acqinsition  process.  MSE  is  the  first  system  to  be  procured  under  a 
streamlined  acquisition  plan  designed  to  shorten  the  normal  acquisition 

h  e  J/?la!1ve  ^ort  period  of  time,  the  MSE  NDI  procurement 
strategy  has  fielded  a  complete  division  set  of  equipment.  While  the  MSE 
system  Is  not  without  problems.  It  has  experienced  fir  fewer  problem! 

befn.SfPected'  Particularly  In  light  of  the  magnitude  of 
the  MSE  NDI  acquisition  process.  The  Army  Is  initiating  a  plan  to 
correct  deficiencies  Identified  during  FOT&E .  The  MSE  system  will 

und®!Tgo  substantial  changes  as  these  corrections  are  Implemented 
and  new  problems  are  identified. 

While  DOT&E  is  concerned  about  the  problems  identified  during  FOT&E 

nrLJ!meS!rent  ?  f?  1  nto  cons  1  deratl on :  the  magnitude  of  the  MSE* 

’  thS  r®1at1ye]y  raPld  acquisition  and  deployment  of  a  complete 
division  set  of  equipment;  and  the  early  exposure  of  the  system  to  a 
major  operational  test.  The  Army  acknowledges  that  not  all  user 
requirements  were  met.  However,  a  large  majority  of  the  FOT&E  test 
participants  judged  MSE  to  be  much  better  that  the  current  system. 

rnx8c1Ve!l  nature  of  the  system,  the  deficiencies  identified  during 
FOT&E  and  the  necessity  to  ensure  system  effectiveness  at  the  corps-level 

w’"  ,ns,st  that  ths  A™*  conduct  a  wrl.rSf 

*nd  assessments  of  an  operational  nature  to  ensure 

SnXhniH  S1  eare  corr®fted  and  appropriate  means  are  in  place  to 
withhold  funds  If  the  corrections  are  not  accomplished  satisfactorily. 

x!s  process  ensure  that  the  Items  delivered  are  operationally 
effective  and  suitable. 
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OPERATIONAL  TEST  AND  EVALUATION  REPORT 

ON  THE 

M9  Armored  Combat  Earthmover 
(M9  ACE) 


The  Office  of  the  Director,  Operational  Test  and 
Evaluation  has  completed  its  assessment  of  the  M9  ACE.  This 
report  is  being  submitted  in  fulfillment  of  the  provisions  of 
10  USC  138. 

The  operational  test  and  evaluation  of  the  M9  ACE  was 
adequate  to  provide  the  information  necessary  to  reach  a 
production  decision  for  the  system.  The  testing  was  conducted 
in  as  realistic  an  environment  as  could  be  achieved. 

As  tested,  the  M9  ACE  demonstrated  an  operationally 
effective  capability  to  carry  out  its  mission  of  earthmoving  in 
support  of  combat  engineer  tasks.  Its  productivity  is  enhanced 
by  better  survivability  and  responsiveness  than  the  medium 
bulldozer  system  it  is  to  replace.  Operational  suitability  of 
the  M9  ACE  has  been  markedly  improved  by  an  aggressive  and 
effective  series  of  engineering  changes;  its  reliability 
exceeds  criteria,  and  its  maintainability  is  expected  to  exceed 
criteria  when  corrections  based  on  previously  successful 
configurations  are  applied. 

A  description  of  the  M9  ACE  and  the  adequacy  of 
operational  tests  conducted,  together  with  amplifying 
information  on  operational  effectiveness  and  suitability 
follows . 


i 
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SYSTEM  DESCRIPTION 


The  M9  Armored  Combat  Earthmover  (M9  ACE)  is  a  tracked, 
lightly  armored,  amphibious,  combat  engineer  vehicle  designed 
to  perform  dozing,  scraping,  rough  grading,  towing,  and  limited 
hauling  missions.  It  was  developed  to  perform  the  engineer 
tasks  of  survivability  (e.g.,  prepare  fighting  positions  for 
tanks),  mobility  (e.g.,  breach  antitank  ditches),  and 
countermobiiity  (e.g.,  dig  antitank  ditches). 

The  M9  ACE  has  a  hydraulic  suspension  system  that  operates 
in  two  modes:  sprung,  used  for  travelling;  and  unsprung,  which 
allows  the  vehicle  to  be  raised,  lowered,  or  tilted  for 
working.  The  front  portion  of  the  vehicle  is  an  open-top  box 
known  as  the  scraper  bowl  or  ballast  compartment.  The  front  of 
the  bowl  is  opened  or  closed  by  raising  or  lowering  the  apron 
with  its  integral  dozer  blade.  The  bowl  is  filled  with  earth 
by  raising  the  apron  and  moving  forward  while  scraping. 

Dropping  the  apron  retains  the  earth  in  the  bowl  for  use  as 
ballast  to  improve  dozing  capability.  The  ballast  is  emptied 
by  raising  the  apron  and  pushing  forward  with  a  hydraulic 
ejector  which  forms  the  rear  wall  of  the  cowl. 

The  M9  ACE  is  designed  to  negotiate  cross-country  terrain, 
attain  29  miles  per  hour  road  speed,  swim  at  3  miles  per  hour, 
and  be  air  transported  in  C-130  and  larger  aircraft.  It 
provides  radio  communication,  chemical  and  biological 
protection  for  the  operator,  and  a  smoke  obscuration  capability 
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TESTING  ADEQUACY 


M9  ACE  development  started  in  1958  under  the  program  name 
Universal  Engineer  Tractor;  the  current  name  was  adopted  in 
1980.  Oversight  by  the  office  of  the  Director,  Operational 
Test  and  Evaluation  (DOT&E)  began  in  1984.  Following  an 
extended  series  of  tests,  reviews,  and  changes,  15  M9  ACE's 
were  built  under  a  1982  contract  In  1983  the  Department  of 
the  Army  directed  that  a  scheduled  Initial  Production  Test  at 
Aberdeen  Proving  Ground,  MD,  be  expanded  in  scope  to  include  a 
concurrent  Force  Development  Test  and  Experimentation  intended 
to  provide  operational  test  data  prior  to  further  contract 
award.  A  Follow-on  Evaluation  was  conducted  in  1985  and  an 
Initial  Production  Test  Operational  Phase  was  conducted  in 
1988.  The  test  plan  for  the  Operational  Phase  was  approved  by 
the  Director,  Operational  Test  and  Evaluation,  and  DOT&E 
observed  the  conduct  of  the  test.  The  three-test  sequence 
provided  data  adequate  to  assess  M9  ACE  operational 
effectiveness  and  suitability. 


Initial  Production  Test/Force  Development  Test  and 
Experimentation  (IPT/FDTE)  (April  to  June  1984) 

The  FDTE  operational  portion  of  the  overall  test  was 
conducted  at  Aberdeen  Proving  Ground,  MD  by  the  US  Army  Armor 
and  Engineer  Board.  Three  of  the  15  vehicles  produced  under 
the  1982  contract  were  used  by  soldiers  of  the  proper  military 
occupational  specialty  (MOS)  for  847  test  hours  under 
operational  conditions.  The  vehicles  were  maintained  by 
soldiers  of  the  proper  MOS  who  received  contractor  training, 
supplemented  by  advice  from  the  contractor  when  maintenance 
manual  or  procedural  problems  were  encountered.  Mission 
performance;  reliability,  availability,  and  maintainability 
(RAM);  human  factors  engineering;  and  correction  of  previously 
noted  deficiencies  were  addressed.  Simulations  were  conducted 
to  support  evaluation  in  two  areas:  worksite  traf f icability 
and  to  establish  a  job-related  basis  for  assessment  of  the 
relationships  of  productivity,  reliability,  and  maintenance 
down  time.  Test  limitations  were  noted  in  maintenance  manuals 
that  were  incomplete  or  outdated  and  in  vehicle  hull  dimensions 
that  were  not  in  compliance  with  the  Technical  Data  Package, 
leading  to  damage  by  mechanical  interference  between  the 
vehicle  hull  and  track.  The  limitations  did  not  significantly 
affect  the  evaluation  and,  in  fact,  contributed  to  the 
conclusion  that  thorough  testing  in  an  operational  environment 
was  needed. 
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Follow-On  Evaluation  (FOE)  (Marc h  to  June  1985) 

In  August  1984  the  Vies  Chief  cf  Staff,  Army,  directed  that 
a  side-by-side  comparison  of  the  M9  ACE  and  the  D7  dozer  system 
be  conducted  to  resolve  uncertainties  remaining  after  the 
IPT/FDTE  ^escribed  above.  The  D7  system  includes  the  standard 
medium  crawler  tractor,  the  M916  truck  tractor,  and  the  M172A2 
lowbed  semitrailer.  The  FOE  conducted  at  Ft.  Hood,  TX,  by  the 
US  Army  Training  and  Doctrine  Commend  Combined  Arms  Test 
Activity,  employed  seven  of  each  system;  the  M9  fleet 
accumulated  1573.8  operating  hours;  the  dozers  1420.6  hours; 
the  truck  tractors  975  hours;  and  the  trailers  381.6  hours. 
Mission  performance,  amphibious  capability,  survivability/ 
vulnerability,  RAM,  training,  logistics,  human  factors,  and 
safety  were  addressed.  Modeling  and  wargame  analysis  were 
required  in  conjunction  with  test  results  to  evaluate 
survivability/vulnerability.  Vulnerability  of  the  M9  ACE  and 
D7  systems  was  obtained  by  Ballistics  Research  Laboratory/Army 
Materiel  Systems  Analysis  Activity  (BRL/AMSAA)  from  panel  shots 
and  modeling;  engagement  probabilities  were  obtained  from 
results  of  a  Scenario  Oriented  Recurring  Evaluation  System 
(SCORES)  Europe  wargame  analysis  conducted  by  the  Combined  Arms 
Operational  Research  Activity  (CAORA)  with  subject  matter 
experts  from  the  US  Army  Armor,  Infantry,  and  Engineer 
Schools.  Responsiveness  values  (movement  rates)  were  obtained 
from  the  AMSAA  Army  Mobility  Model  as  well  as  from  test  data. 
There  were  no  test  limitations  that  affected  assessment  of 
effectiveness  and  suitability. 


Initial  Production  Test  Operational  Phase  (June  to  August  1988) 

This  test  phase  was  conducted  at  Aberdeen  Proving  Ground, 
MD,  under  the  control  of  USAOTEA  and  US  Army  Tost  and 
Evaluation  Command  Combat  Systems  Test  Activity.  Six  M9  ACE 
vehicles  were  operated  and  maintained  through  direct  support 
level  by  soldiers  of  the  proper  military  occupational 
specialty.  A  total  of  1805.8  operating  hours  were  attained 
under  typical  operational  conditions.  The  purpose  of  the  test 
was  to  address  concerns  remaining  following  the  1985  FOE 
described  above.  These  concerns  were:  unsafe  hatch,  low  RAM, 
reduced  productivity,  transition  from  a  Technical  Data  Package 
to  production,  and  effectiveness  of  engineering  changes  (53) 
made  as  a  result  of  previous  testing.  No  modeling  or 
simulation  was  used  in  conjunction  with  this  test.  There  were 
no  significant  test  limitations  affecting  operational 
effectiveness  or  suitability  assessment. 

The  test  sequence  described  above  was  sufficient  to 
sequentially  identify  deficiencies,  shortcomings,  and  faults 
and  to  prove  the  adequacy  of  corrective  actions  applied  in  all 
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important  areas.  In  five  relatively  minor  areas  (hose 
identification,  plastic  windshield,  addition  of  an  impact 
wrench,  modification  of  track  retainer,  and  battery  access) 
test  results  were  inconclusive,  incomplete,  or  show  the 
correction  to  be  marginally  successful.  Tenting  to  determine 
the  affects  of  electromagnetic  interference  and  electromagnetic 
pulse  have  not  been  accomplished;  these  tests  are  technical  in 
nature,  but  the  results  may  have  operational  implications. 
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OPERATIONAL  EFFECTIVENESS  AND  SUITABILITY 


The  1984  IPT/FDTE  and  the  1985  FOE  were  conducted  using 
what  are  considered  to  be  pre-production  prototypes;  the  1988 
Operational  Phase  of  the  IPT  was  conducted  with  low-rate 
initial  production  (LRIP)  vehicles.  All  testing  was 
accomplished  by  soldier  operators  and  mechanics  (through  the 
direct  support  level)  of  the  proper  military  occupational 
specialty  under  conditions  simulating  combat  engineer  operation 
in  accordance  with  an  approved  operational  mode  summary/mission 
profile. 

Operational  testing  addressed  six  critical  operational 
issues:  mission  performance;  survivability;  reliability, 
availability,  and  maintainability  (RAM);  logistical  support; 
human  factors;  and  safety.  In  addition,  DOT&E  concerns 
expressed  after  the  1985  FOE  were  addressed  specifically  in  the 
Operational  Phase  of  the  1988  IPT. 

Test  missions  in  all  cases  involved  performance  of  engineer 
tasks  of  survivability  (e.g.,  prepare  fighting  positions  for 
tanks),  mobility  (e.g.,  breach  antitank  ditches),  and  counter 
mobility  (e.g.,  dig  antitank  ditches).  Scenarios  were 
constructed  to  attain  proportional  allocation  of  activities  in 
accordance  with  an  operational  mode  summary.  The  bulk  of  this, 
44%,  was  dozing;  traveling  and  grading  were  each  22%;  the 
remainder,  in  decreasing  order,  were  haul,  scrape,  swim,  winch, 
and  tow. 

The  results  of  the  test  series  led  to  the  following 
findings : 


Mission  Performance  M9  ACE  mission  performance 
comprises  dozing,  travel,  scraping,  hauling,  grading,  towing, 
swimming,  and  winching.  The  M9  ACE  was  intended  by  design  to 
have  bulldozing  characteristics  comparable  to  the  medium  size 
crawler  tractor  which  it  is  to  replace.  The  1984  IPT/FDTE 
tested  only  the  M9  ACE;  the  evaluation  conducted  following  the 
test  extracted  data  from  earlier  comparison  tests,  which  were 
somewhat  clouded,  and  inferred  that  M9  ACE  productivity  in 
earthmoving  was  from  40%  to  70%  of  D7  capability. 

Based  on  these  results  the  Vice  Chief  of  Staff,  Army, 
directed  that  a  thorough  operational  test  comparing  the  M9  ACE 
and  D7  systems  be  conducted;  this  was  done  in  the  1985  FOE. 

This  test  showed  an  overall  edge  in  digging  for  the  D7,  with 
the  greatest  superiority  in  digging  of  antitank  ditches,  for 
which  the  D7  system  took  three  hours  to  dig  a  100-meter  ditch 
and  the  M9  ACE  took  four  hours .  Other  task  differentials  were 
of  minor  tactical  significance.  A  valid  comparison  of  the  two 
systems,  however,  must  go  beyond  a  simple  review  of  earthmoving 
capability  (measured  in  either  cubic  yards  per  hour  or  time  to 
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complete  a  specific  task)  and  must  incorporate  availability  (a 
product  of  reliability  and  maintainability),  system 
survivability,  and  system  responsiveness.  An  integrated 
assessment  of  this  type  showed  that  the  M9  ACE's  superiority  in 
moving  rapidly  between  scattered  tasks  and  in  survivability 
more  than .compensated  for  the  D7‘s  digging  advantage.  An 
element  of  major  concern  for  the  Operational  Phase  of  the  1988 
IPT  resulted  from  an  engineering  change  applied  following  the 
FOE  to  eliminate  the  transmission  output  shaft  failure  mode. 
Theoretically,  this  change  could  reduce  the  M9  ACE  speeds  in 
reverse  and  thus  reduce  productivity.  This  concern  was  allayed 
when  the  Operational  Phase  demonstrated  no  change  in  digging 
capability  (within  +  6%)  for  the  modified  M9  ACE  in  comparison 
with  an  M9  ACE  in  1985  FOE  configuration. 

In  other  aspects  of  mission  performance,  the  following  was 
found: 


Worksite  traff icability.  In  the  1984  FDTE  and  earlier 
testing  at  Aberdeen  Proving  Ground,  MD,  an  M9  ACE  tendency  to 
become  stuck  while  digging  was  noted  as  a  major  potential 
problem.  This  was  addressed  specifically  in  the  1985  FOE, 
where  it  was  found  that  the  M9  ACE  and  D7  systems  got  stuck 
with  equal  freguency  when  doing  comparable  jobs.  Thus  it  is 
clear  that  getting  stuck  is  a  thing  that  happens  in  these 
operations  and  is  not  a  problem  created  by  the  M9  ACE  itself. 

Amphibious  operations.  The  1985  FOE  showed  that  the 
M9  ACE  can  swim  in  calm  water  at  the  3-mile-per-hour  speed 
criterion  and  can  enter  and  exit  the  water  on  natural  stream 
banks  with  slopes  of  20%,  and  at  pre-existing  ramps  with  slopes 
of  13%.  Both  the  M9  ACE  and  the  D7  got  stuck  more  than  half 
the  time  while  constructing  ramps  into  the  water,  possibly  due 
in  part  to  techniques  used.  Further,  time  to  prepare  to  swim 
is  long:  2.5-hours  at  the  1984  IPT /FDTE  and  1.7  hours  at  the 
1985  FOE.  These  considerations,  coupled  with  an  unknown 
controllability  in  moving  water,  lead  to  the  judgement  that  the 
M9  ACE  should  be  expected  to  swim  in  tactical  operations  only 
when  absolutely  necessary.  Since  the  approved  operational  mode 
summary  only  calls  for  swimming  2%  of  the  time,  this  is  of 
little  import. 

Radio  communications.  In  the  1984  FDTE  and  the  1985 
FOE  radio  communications  were  ineffective  or  marginal, 
respectively.  In  both  tests  the  radio  was  located  in  the  right 
rear  corner  of  the  vehicle.  As  a  result,  the  operator  had  to 
leave  his  operating  station  to  change  frequencies,  and  the 
32-foot  cable  connecting  the  radio  to  the  operators  station  was 
frequently  damaged,  with  engine  removal  required  for  cable 
replacement.  In  addition,  the  box  the  radio  was  in  blocked 
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ready  access  to  the  batteries.  For  the  1988  1PT,  as  one  of  53 
engineering  changes,  the  radio  was  relocated  to  a  position  at 
the  rear  of  the  operator's  station.  This  allowed  ready  access 
to  all  radio  controls  at  all  times,  eliminated  the  cable- 
failure  problem,  and  freed  the  area  above  the  batteries  for  a 
folding  stowage  box.  This  change  is  considered  to  be 
operationally  effective  and  suitable. 

Fuel  capacity.  The  criterion  for  carrying  enough  fuel 
for  200  miles  of  secondary  road  travel  has  mission  performance 
application  and  was  addressed  in  the  1985  FOE.  It  was  found 
that  under  convoy  conditions  on  secondary  roads  the  M9  ACE 
could  travel  between  approximately  150  and  170  miles  on  a  tank 
of  fuel;  thus  fuel  cans  would  have  to  be  carried  to  meet  the 
criterion.  Since  such  a  trip  would  be  planned  in  advance,  the 
provision  of  the  extra  fuel  is  not  seen  as  a  problem,  and 
stowage  space  in  the  bowl  would  be  available  since  the  vehicle 
would  be  unballasted.  In  terms  of  ordinary  mission 
accomplishment,  all  testing  has  shown  that  the  vehicle  carries 
enough  fuel  to  complete  the  usual  10-12  hour  mission.  Fuel 
capacity  is  thus  judged  to  be  adequate. 

Survivability.  The  USAOTEA  independent  evaluation  of 
the  1985  FOE  provides  an  extensive  examination  of  comparative 
survivability  of  the  M9  ACE  and  D7  systems.  Using  test  data  in 
combination  with  simulation  and  wargame  results  (cited  under 
the  Test  Adequacy  section  above),  the  evaluation  jhowed  the  M9 
ACE  to  be  much  more  survivable  than  the  D7  system.  A  force 
remaining  projection  showed  that  initial  sets  of  25  M9  ACEs  and 
25  D7  systems  would  be  reduced  to  20  and  4  systems, 
respectively,  at  the  end  of  10  days  of  combat  operations. 

These  figures  do  not  account  for  system  restoration  or 
rebuild.  The  outcome  is  reasonable:  the  M9  ACE  has  armor 
similar  to  the  M113  Armored  Personnel  Carrier;  the  D7  system 
(bulldozer,  truck  tractor,  and  semitrailer)  has  no  armor,  and 
presents  larger  total  and  vulnerable  areas.  The  better 
survivability  characteristics  improve  M9  ACE  mission 
performance  by  avoiding  high  system  loss  rates. 

The  M9  ACE  hatch,  which  is  there  because  of 
survivability  considerations,  was  both  a  DOT&E  concern 
following  the  1985  FOE  and  one  of  the  53  engineering  changes 
addressed  prior  to  the  1988  IPT.  The  concern  arose  from  human 
factors  and  safety  attributes.  In  its  original  design,  the 
hatch. was  both  very  difficult  to  open  or  close  and  had  an 
insecure  latch.  It  was  completely  redesigned  prior  to  IPT. 
During  IPT,  hatch  opening  and  closing  force  requirements  were 
found  unacceptable;  this  was  attributed  to  improper  adjustments. 
Attempts  to  plroperly  adjust  the  hatch  in  accordance  with  the 
manual  did  not  correct  the  problem.  A  revised  adjustment 
procedure  was  developed  following  the  test,  and  the  hatch  then 
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demonstrated  acceptable  force  requirements.  However,  the 
revised  procedures  have  not  yet  been  tested  for  operational 
durability  purposes.  This  aspect,  along  with  several  others 
enumerated  in  the  conclusion  section  below,  should  be  checked 
before  fielding  the  system,  but  none  presents  a  risk  so  great 
as  to  preclude  full  production. 


Reliability,  availability,  and  maintainability  (RAM). 

The  comprehensive  and  aggressive  program  to  improve  RAM  of 
the  M9  ACE  has  been  successful.  Reliability  is  better  than  the 
criteria  and  should  improve  still  more  with  additional  changes 
yet  to  be  applied.  Maintainability  as  tested  in  the  IPT  does 
not  quite  meet  the  criteria  but  is  expected  to  with  the 
additional  changes. 

Following  the  1984  FDTE,  RAM  shared  the  spotlight  with 
mission  performance  as  an  area  of  major  concern.  At  that  time 
following  a  pattern  established  in  earlier  testing,  hydraulic 
devices,  lines,  and  fittings  were  the  largest  single  source  of 
system  failures,  and  required  more  maintenance  man-hours  than 
any  other  components.  Mean  time  between  operational  mission 
failures  was  22  hours,  and  the  maintenance  ratio  was  0.64  man 
hours  per  operating  hour.  Both  figures  were  unilaterally 
determined  by  USAOTEA  since  the  only  approved  failure 
definition  and  scoring  criteria  at  that  time  addressed  hardware 
only.  The  1984  USAOTEA  evaluation  quantified  the  productivity 
improvement  that  could  be  realized  by  correcting  RAM  problems. 
The  1985  FOE  did  not  repeat  the  hydraulic  system  failure 
history,  apparcmtly  due  to  engineering  changes  and  improved 
quality  control.  However,  it  did  reveal  a  critical  failure 
mode  in  transmission  output  shafts,  with  five  failures.  The 
maintenance  burden  associated  with  this  was  judged  to  be 
unacceptable.  Despite  several  changes  made  to  the  M9  ACE 
system  following  the  1984  FDTE,  operational  reliability  showed 
only  a  slight  improvement  in  the  1985  FOE  with  a  projected 
value  of  26  mean  hours  between  operational  mission  failures. 

The  projection  took  into  account  the  anticipated  effectiveness 
of  corrections  to  be  applied.  The  maintenance  ratio  projected 
was  0.68  manhours  per  operating  hour,  a  slight  degradation  from 
the  1984  FDTE.  Coupled  with  the  transmission  output  shaft 
failure  mode,  these  figures  led  to  29  engineering  changes  to 
improve  reliability  and  maintainability.  The  efficacy  of  these 
changes  is  demonstrated  by  results  of  the  1988  IPT:  31  mean 
hours  between  operational  mission  failures  as  tested,  with 
projections  of  54  (elimination  of  failures  supported  by 
historical  information)  to  80  (based  on  expected  effectiveness 
of  all  fixes);  and  maintenance  ratios  of  0.50,  0.37,  and  0.32 
for  the  same  categories  (tested,  historical  information,  and 
all  fixes),  respectively. 
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Logistical  Support,  Road  wheel  usage  continues  as  the 
majcr  logistical  support  problem.  Usage  rates  for  the  1985  FOE 
were  duplicated  for  the  1988  IPT  and  are  such  that  an  M9  ACE 
can  be  expected  on  average  to  require  one  new  road  wheel  for 
each  12  hours  of  operation.  Work  continues  to  improve  the  road 
wheel  life,  but  a  quick  solution  is  not  likely.  The  burden 
associated  with  this  failure  rate  is  not  as  oppressive  as  it 
had  been  earlier;  one  of  the  53  engineering  changes  made 
subsequent  to  the  1985  FOE  was  the  development  of  a  dogbone 
jack  to  raise  the  road  wheel.  This  jack  is  simple  to  use  and 
effective.  Intermediate  road  wheels  now  can  be  changed 
routinely  in  15  to  30  minutes.  Another  effective  engineering 
change  was  the  addition  of  a  pressure  gauge  that  permits 
diagnosis  of  the  complex  hydraulic  system.  Spare  parts  types 
and  quantities  continue  to  be  updated  based  on  experience 
gained,  as  do  the  technical  manuals  and  repair  procedures. 

Human  Factors.  Human  factors  considerations  were  the 
direct  incentive  for  6  of  the  53  engineering  changes  made 
following  the  1985  FOE  and  were  a  contributing  factor  for  11 
others  in  conjunction  with  safety,  maintainability,  and  mission 
performance.  All  but  one  were  found  to  be  effective  and 
suitable  in  easing  operator  or  maintainer  tasks.  The  exception 
was  in  ease  of  battery  access,  which  is  improved  but  still 
cumbersome.  All  changes  based  on  human  factors  were  undertaken 
with  the  expectation  of  improved  performance  in  operations  or 
maintenance,  not  simply  comfort.  The  1988  IPT  showed  no 
discernible  degradation  in  the  system's  ability  to  dig,  despite 
mechanical  changes  that  were  biased  towards  decreased 
effectiveness,  accompanied  by  a  major  improvement  in 
maintenance  times . 

Safety.  Seven  of  the  53  engineering  changes 
implemented  following  the  1985  FOE  were  based  primarily  on 
safety  considerations,  and  3  other  changes  were  partially  due 
to  safety.  No  significant  injuries  occurred  in  the  1985  FOE; 
therefore  it  is  only  observation  and  judgement  that  leads  to 
the  conclusion  that  these  were  effective  changes,  and  that  the 
potential  for  injury  has  been  reduced  as  a  result  of  the 
changes.  On  the  other  hand,  it  seems  inconceivable  that  any  of 
the  changes  such  as  ejector  lock,  seat  belt  attachment,  or 
nonskid  surfaces  would  be  eliminated  because  no  quantifiable 
data  shows  their  contribution.  Operator  and  maintainer  safety 
is  better  now  than  it  was  before,  and  the  consequences  of  a 
lack  of  vigilance  are  less  serious  now  because  of  the  changes. 

DOT&E  Concerns .  Following  the  1985  FOE,  DOT&E 
expressed  five  remaining  concerns.  They  were  the  hatch,  RAM, 
productivity,  transition  from  the  Technical  Data  Package  to 
production,  and  the  effectiveness  of  the  implemented 
engineering  changes.  All  have  been  discussed  under  the  issues 
addressed  above.  In  summary,  DOT&E  concerns  have  been 
satisfactorily  addressed. 
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CONCLUSION 

As  tested  the  M9  ACE  has  been  found  to  be  operationally 
effective  and  suitable.  However,  additional  engineering 
changes  are  planned,  and  the  M9  ACE  should  not  be  fielded  until 
a  suitable  test  is  performed  to  prove  that  these  changes  are 
adequate,  and  are  applied  to  all  produced  vehicles. 

The  planned  corrections  address:  drain  valve  durability; 
steer  unit  torque  link  durability;  steer  unit  bolt  durability; 
parking  brake  cable  durability;  brake  chamber  bracket 
durability;  and  hatch  durability.  All  can  be  addressed 
adequately  in  the  already  planned  and  contractually  required 
comparison  test  of  M9  ACE  vehicle  performance  versus 
contractual  requirements.  The  test  will  accumulate  300  hours 
of  operation  on  each  of  two  vehicles;  it  is  to  be  conducted 
from  February  to  April  1989. 

The  comparison  test  is  to  be  monitored  by  USAOTEA  under 
their  continuous  and  comprehensive  evaluation  (C2E) 
methodology,  with  results  reported  to  DOT&E  by  means  of  a  C2E 
Update  Report.  Produced  M9  ACE  vehicles  may  be  allocated  to 
and  used  by  the  Engineer  Center  and  School  for  training 
purposes.  All  fixes  must  be  certified  effective  by  USAOTEA  and 
be  applied  to  all  produced  vehicles  prior  to  fielding  to  line 
units,  which  is  expected  to  begin  in  July  1989. 
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OPERATIONAL  TEST  AND  EVALUATION 

The  Office  of  the  Director,  Operational  Test  and 
Evaluation,  has  completed  its  assessment  of  the  testing  of  the 
Air  Force  Low  Altitude  Navigation  and  Targeting  Infrared  System 
for  Night  (LANTIRN)  Targeting  Pod.  This  testing  included  the 
Initial  Operational  Test  and  Evaluation  (IOT&E),  Follow-on 
Operational  Test  and  Evaluation,  Phase  One  (F0T&E( 1 ) ) ,  and 
extensive  flight  testing  since  July  1987.  This  report  is  being 
submitted  in  fulfillment  of  the  provisions  of  Title  10,  U.S.C. 
138. 


Due  to  recent  availability  and  testing  of  aircraft  equipped 
with  production  avionics,  the  production  LANTIRN  targeting 
(TGT)  pod  has  demonstrated  effective  interface  and  performance 
with  both  the  F-16  Block  40  and  the  F-15E.  Consequently,  I  now 
consider  that  LANTIRN  TGT  pod  testing  has  been  adequate  to 
assess  its  operational  effectiveness  and  suitability  as 
satisfactory. 

IOT&E,  Phase  2,  of  the  LANTIRN  system  was  conducted  from 
January  to  April  1986  with  major  deficiencies  noted  on  the  TGT 
pod.  Based  on  test  results  of  IOT&E,  the  navigation  (NAV)  pod 
component  of  the  LANTIRN  system  was  recommended  for  full-rate 
production.  A  DOT&E  Beyond  Low-rate  Initial  Production 
(B-LRIP)  Report  on  the  NAV  pod  was  submitted  to  the  Congress  in 
November  1986.  FOT&E(l)  of  the  LANTIRN  system  was  conducted 
from  December  1986  to  July  1987  for  the  purposes  of:  (1) 
evaluating  corrections  to  deficiencies  identified  during  the 
previous  IOT&E,  and  (2)  further  evaluating  and  assessing 
operational  effectiveness  and  suitability  objectives  that  were 
not  completed  during  IOT&E.  FOTSE(l)  test  results  did  not 
support  a  full-rate  production  decision  for  the  targeting  pod. 
Subsequent  to  FOT&E(l),  the  Air  Force  conducted  extensive 
developmental  flight  tests  on  LANTIRN  and  test/training  flights 
for  F-16C/D  and  F-15E  pilots  preparing  to  conduct  IOT&E  on 
those  aircraft  using  LANTIRN. 

The  two  formal  phases  of  operational  testing  of  the  LANTIRN 
TGT  pod,  combined  with  extensive  flight  testing  in  the 
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past  18  months,  have  resulted  in  adequate  testing  being  done  to 
determine  the  functional  performance  and  operational 
effectiveness  of  the  LANTIRN  targeting  pod.  There  was, 
however,  a  major  test  limitation.  End-to-end  operational 
testing  of  the  production  targeting  pod  as  a  component  of  the 
production  F-16C/D  Block  40/LANTIRN  weapon  system  or  the 
production  F- 1 5E/LANT I RN  weapon  system  is  incomplete  because  of 
late  delivery  of  the  production  aircraft.  This  test  limitation 
will  be  overcome  in  the  near  future  as  production  models  of 
both  aircraft  become  available  for  operational  tests.  Formal, 
DOT&E-approved  IOT&E  of  the  F-15E  has  already  begun,  and  F-16 
Block  40  IOT&E  will  begin  during  the  summer  of  1989.  Results 
of  LANTIRN  operational  effectiveness  with  these  production 
aircraft  will  be  assessed  and  reported  to  the  Congress  by 
DOT&E .  The  first  production  LANTIRN  TGT  pod  was  delivered  in 
August  1988  and,  in  developmental  tests,  has  demonstrated  that 
it  can  perform  its  primary  functions  of  target  acquisition  and 
aiding  in  weapon  delivery.  Consequently,  the  results  of 
previous  operational  effectiveness  testing  in  FOT&E(l)  of  the 
FSD  TGT  pod  on  testbed  aircraft  with  early  versions  of 
production  aircraft  software  remain  valid  and  can  be  considered 
a  minimum  baseline  for  production  TGT  pod  performance.  At  the 
end  of  FOT&E( 1 ) ,  Maverick  missile  weapon  delivery  capability 
was  considered  satisfactory.  Laser  guided  bomb  (LGB)  delivery 
was  considered  marginal  on  the  F-16,  but  with  demonstrated 
improvements  in  the  TGT  pod,  it  is  now  considered  by  DOT&E  to 
be  at  least  satisfactory  against  a  limited  target  set. 
Conventional  weapon  delivery  with  LANTIRN,  which  was  previously 
largely  untested  in  operational  scenarios,  has  demonstrated 
functional  integration  in  recent  testing  and  will  be 
extensively  demonstrated  in  the  upcoming  F-15E  and  F-16  Block 
40  lOT&Es . 

IOT&E.  FOT&E( 1 )  and  additional  flight  test  data  during  the 
past  18  months  were  adequate  to  make  an  evaluation  of  the 
LANTIRN  system's  operational  suitability.  It  is  important  to 
know  that  this  statement  is  made  with  the  understanding  that 
the  Air  Force  intends  to  support  LANTIRN  using  contractor 
support  at  Luke  AFB  until  1990.  The  first  operational  unit  at 
Seymour- Johnson  AFB  will  have  a  full  Air  Force  organic 
maintenance  capability  for  the  NAV  pod  starting  in  May  1989. 
Contractor  support  and  lack  of  integrated  logistics  support 
(ILS)  equipment  are  major  limitations  to  LANTIRN  testing  which 
affect  suitability  assessments.  For  example,  the  Air  Force's 
capability  to  maintain  the  targeting  pod  (and  entire  LANTIRN 
system)  has  been  estimated  from  observations  of  the 
contractor-performed  maintenance  and  limited  "blue  suit" 
hands-on  experience.  After  FOT&EU),  TGT  pod  operational 
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suitability  was  evaluated  to  be  marginal  using  contractor 
maintenance  and  support.  Design  improvements  to  the  TGT  pod, 
flight  tested  over  the  past  year,  and  recent  support  equipment 
evaluations  demonstrated  that  the  TGT  pod's  operational 
suitability  clearly  has  the  potential  to  be  satisfactory  using 
organic  (Air  Force)  maintenance,  The  Air  Force  intends  for  the 
contractor  to  support  LANTIRN  until  ILS  elements  and  fully 
trained  Air  Force  maintenance  personnel  are  available.  The  Air 
Force's  capability  to  maintain  LANTIRN  will  be  assessed  in  a 
1989  supportabi lity  evaluation  and  a  1990  maintainability 
demonstration.  The  results  of  both  will  be  evaluated  and 
reported  to  the  Congress  by  DOT5.E. 

A  description  and  assessment  of  the  LANTIRN  TGT  pod  ^nd  the 
operational  tests  conducted,  together  with  amplifying 
information  on  operational  effectiveness  and  operational 
suitability  follows. 
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F-16  with  LANTIRN  Navigation  and  Targeting  Pods 
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SYSTEM  DESCRIPTION  AND  BACKGROUND 

The  Low  Altitude  Navigation  and  Targeting  Infrared  System 
for  Night  (LANTIRN)  is  designed  to  provide  a  night  attack 
capability  for  use  on  the  F-16C/D  Block  40  and  F-15E  aircraft. 
The  LANTIRN  system  consists  of  a  wide  field  of  view  (WFOV) 
head-up  display  (HUD) ,  a  navigation  (NAV)  pod  and  a  targeting 
(TGT)  pod.  The  head-up  display  is  an  electro-optical  device 
which  displays  flight,  navigation  and  weapon  delivery 
information  in  the  pilot's  line-of-sight .  The  NAV  pod  contains 
a  forward-looking  infrared  receiver  (FLIR) ,  a  terrain-avoidance 
radar  and  subsystems  for  servo-control.  The  TGT  pod  functions 
include  FLIR  imaging,  laser  designation,  precision  pointing  and 
tracking,  and  missile  boresight  correlation  for  AGM-65D 
Maverick  missile  hanaoff  and  lock-on. 

The  F-16  WFOV  HUD  received  production  approval  in  October 
1984.  The  LANTIRN  development  program  was  restructured  in  1984 
because  development  of  the  TGT  pod  was  lagging  the  NAV  Pod  and 
the  WFOV  HUD.  Program  restructuring  resulted  in  the  NAV  pod 
reaching  a  full  production  decision  point  in  October  1986,  more 
than  a  year  before  the  same  planned  decision  point  for  the  TGT 
pod.  The  LANTIRN  NAV  pod  was  approved  for  full  production  by 
the  Air  Force  and  was  the  subject  of  a  Director,  Operational 
Test  and  Evaluation  (DOT&E)  Beyond  Low-rate  Initial  Production 
(B--LRIP)  Report  dated  14  November  1986.  The  Air  Force  also 
decided  in  October  1986,  and  again  in  October  1987,  to  continue 
the  TGT  pod  in  low-rate  production  pending  correction  of 
ief iciencies  observed  in  operational  testing.  In  January  1988, 
the  Director,  Operational  Test  and  Evaluation,  and  the  Air 
Force  agreed  to  eighteen  criteria  which  could  be  used  to 
measure  LANTIRN  test  progress  and  TGT  pod  deficiency 
corrections  in  the  absence  of  a  formal  operational  test  program 
before  the  next  planned  decision  milestone  in  October  1988.  In 
November  1988.  the  Air  Force  assessed  the  test  results  and 
decided  to  continue  with  low-rate  production  for  the  LANTIRN 
TGT  pod  pending  full  resolution  of  a  laser  designator  problem. . 
After  a  correction  to  the  production  pod  laser  problem  was 
demonstrated,  the  Air  Force  made  a  full-me  or  ruction 
decision  in  December  1988  causing  the  Director  to  submit  this 
report  in  fulfillment  of  Title  10  U.S.C.  13 1. 

Operational  testing  of  the  TGT  pod  component  of  the  LANTIRN 
system  was  begun  in  the  second  phase  of  LANTIRN  Initial 
Operational  Test  and  Evaluation  (IOT&E)  from  January  to  April 
1986  and  continued  in  Follow-on  Test  and  Evaluation,  Phase  1 
( FOT&E ( 1 ) )  which  was  completed  in  July  1987.  Testing  since 
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July  1987  of  LANTIRN  TGT  pod  improvements,  as  well  as  improved 
aircraft  integration  and  weapon  delivery  using  LANTIRN 
production  pods,  has  occurred  in  development  testing  and  in 
LANTIRN  test/ftraining  flights.  These  latter  f  lights  are 
designed  to  prepare  pilots  for  IOT&E  missions  on  the  F-16C/D 
and  F-15E  aircraft  which  will  utilize  the  LANTIRN  system  and 
included  missions  specifically  designed  to  assess  overall 
production  LANTIRN  system  integration.  This  B-LRIP  report  uses 
data  derived  from  all  these  phases  of  LANTIRN  testing,  as  well 
as  the  personal  observations  of  the  Director  and  a  member  of 
his  staff  who  have  both  flown  LANTIRN  missions  in  the  F-16D  and 
F-15E  aircraft. 

Throughout  this  report,  it  is  very  important  to  understand 
the  differences  between  the  components  of  the  complete  LANTIRN 
system.  The  NAV  pod  component  is  primarily  used  for  low 
altitude  navigation.  As  previously  stated,  the  NAV  pod's 
effectiveness,  suitability,  and  test  adegruacy  were  the  subject 
of  an  earlier  DOT&E  B-LRIP  report.  The  TGT  pod,  which  is  the 
subject  of  this  report,  is  used  primarily  in  the  attack  segment 
of  a  typical  mission  profile. 
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TESTING  ADEQUACY 

The  Air  Force  Operational  Test  and  Evaluation  Center 
(AFOTEC)  conducted  the  first  phase  of  LANTIRN  IOT&E  on  F-16 
aircraft  from  October  1984  to  January  1985,  using  only  the  WFOV 
HUD  and  NAV  pod  to  evaluate  the  operational  effectiveness  and 
suitability  of  the  LANTIRN  system  in  support  of  a  low-rate 
initial  production  decision  scheduled  in  February  1985.  The 
test  team  participated  in  319  test  sorties  during  combined 
development  test  and  evaluation  (DT&EJ/IOT&E  at  Edwards  AFB. 
Thirteen  dedicated  IOT&E  missions  were  flown  at  Edwards  AFB  and 
an  additional  52  were  flown  during  a  3-month  deployment  to 
Loring  AFB,  Maine.  The  latter  missions  were  flown  over  New 
Brunswick,  Canada,  in  weather  conditions  representative  of  the 
European  environment.  An  IOT&E  of  the  complete  LANTIRN  system 
could  not  be  done  at  that  time  because  the  TGT  pod  was  not 
available. 

The  second  phase  of  LANTIRN  IOT&E  (with  a  complete  LANTIRN 
system)  was  conducted  from  January  to  April  1986.  The  WFOV  HUD 
and  NAV  Pod  equipment  demonstrated  improved  performance  over 
that  observed  in  prior  testing.  During  this  phase,  testing  was 
conducted  at  five  locations  (McChord  AFB,  Washington;  Ft 
Hunter-Liggett ,  California;  Eglin  AFB,  Florida;  Nellis  AFB, 
Nevada;  NWC  China  Lake,  California).  Operations  from  deployed 
locations  allowed  pilots  to  fly  test  profiles  developed  for 
various  types  of  missions  in  representative  flight  conditions 
over  unfamiliar  (first  look)  routes  and  terrain.  Sixty-three 
effective  test  sorties  were  flown. 

The  critical  operational  issues  which  were  examined  for 
both  phases  of  the  LANTIRN  system  IOT&E  on  the  F-16  were: 

a.  Single-seat  effectiveness.  The  pilot  of 
single-seat  LANTIRN-equipped  aircraft  should  be  able  to  operate 
safely  and  effectively  at  low  altitude  during  day/night 
under-the-weather  conditions. 

b.  Effective  aid  to  navigation.  The  LANTIRN  system 
should  provide  an  effective  aid  to  navigation  at;  low 
altitude  during  day/night  under-the-weather  conditions. 

c.  Transition  to  attack.  The  LANTIRN  system  should 
provide  an  effective  aid  in  the  transition  from  navigation  to 
attack  during  day /night  under-the-weather  conditions. 
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d.  Attack  capability.  The  LANTIRN- equipped  F-X6 
should  have  the  capability  to  acquire  and  attack  targets  using 
current  ordnance  and  delivery  tactics  compatible  with  the 
night,  under-the-weather  environment. 

e.  Survivability.  The  LANTIRN  system  should  improve 
survivability  during  ingress,  attack,  and  egress. 

f.  LANTIRN  reliability  and  maintainability.  LANTIRN 
reliability  and  maintainability  characteristics  should  assure  . 
adequate  availability  and  sortie  generation  capability. 

g.  Supportability .  Air  Force  personnel  must  be  able 
to  support  the  LANTIRN  system  within  the  framework  of  the  Air 
Force  support  system. 

The  major  test  limitations  in  the  first  phase  of  IOT&E  (Oct 
84~Jan  85)  were: 

a.  The  TGT  pod  was  not  available.  (TGT  pod  was 
available  in  later  phases  of  testing.) 

b.  The  employment  of  the  NAV  Pod  in  an  attack  role 
was  not  evaluated  because  the  LANTIRN  system  was  designed  to 
accomplish  target  attack  using  the  TGT  pod  in  conjunction  with 
the  NAV  Pod.  (NAV  pod  attack  capability  was  evaluated  in  later 
FOT&E(l)  when  the  TGT  pod  was  available.) 

c.  Active  threat  simulators  were  not  available  on 
Canadian  ranges.  (Active  simulators  were  used  on  U.S,  ranges 
in  the  second  phase  of  IOT&E  and  FOT&E(l).) 

d.  NAV  pod  maintenance  was  done  solely  by  contractors. 

e.  Evaluations  of  logistics  and  software 
supportability  were  incomplete  because  development  of  most 
integrated  logistics  support  (ILS)  elements  was  deferred  until 
the  production  phase,  and  software  support  resources  plans  were 
not  available  for  evaluation. 

The  major  test  limitations  in  the  second  phase  of  LANTIRN 
IOT&E  (Jan-Apr  86)  were: 

a.  The  tested  NAV  and  TGT  pods  were  not  production 
equipment.  Production  nose  section  heater  and  slip  ring 
assemblies  for  the  TGT  pod  were  not  available.  (Production  TGT 
pod  with  heater  and  slip  ring  assemblies  was  flown  in  1988.) 

b.  Laser  designation  during  LGB  deliveries  and  laser 
ranging  was  used  infrequently  because  of  environmental  and 
safety  constraints.  (A  dual -frequency,  "eye-safe"  laser 
entered  developmental  test  in  1988.) 
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c.  The  pilots'  choices  of  turn-points  for  low-level 
routes  were  limited  to  existing  instrument /visual  (IR/VR)  route 
structure  and  by  range  constraints.  Because  turn-points  could 
not  be  chosen  for  optimum  thermal  signature,  the  navigation 
task  was  more  demanding  than  necessary  in  some  cases. 

d.  The  choice  of  initial  points  (IP)  and  target 
run-in  headings  was  also  limited  by  range  constraints. 
Therefore,  some  attacks  were  executed  under  higher  than 
necessary  workloads. 

e.  The  TGT  pod  WFOV  was  out  of  focus  on  most  test 
sorties  because  of  a  pod  temperature  compensation  algorithm 
error.  Transition  to  attack  was  difficult  or  unsuccessful 
because  WFOV  acquisition  of  targets  or  target  areas  was  not 
possible.  (The  problem  was  corrected  for  FOT&E(l).) 

f.  The  TGT  pod  laser  offset  track  was  available  but 
not  mechanized  properly,  so  precise  positioning  of  the  laser 
spot  utilizing  this  mode  was  not  evaluated.  (Improved  area 
tracking  capability  corrected  this  problem  for  F0T&E(1).) 

g.  The  offset  aim  point  in  the  aircraft  air-to-ground 
mode  was  not  mechanized  properly,  which  hampered  transition  to 
attack  and  target  acquisition.  (The  problem  was  considered 
minor  and  worked  around  in  FOT&E(l).j 

h.  The  LANTIRN  system  was  integrated  with  the  most 
advanced  F-16  software  (Block  2J5B++)  available  at  the  time. 

The  F-16  Block  40  software  and  hardware  planned  for  production 
use  with  LANTIRN  and  other  systems,  such  as  Global  Positioning 
System  (GPS)  and  Automatic  Terrain  Avoidance,  were  not 
available.  Pilot  workload  increased  because  of  not  having  the 
increased  navigational  accuracy  which  will  be  available  with 
GPS.  (F--16s  with  Block  40  avionics  were  flown  with  LANTIRN  in 
1988.  ) 


i.  No  F-16  onboard  electronic  countermeasures  (ECM) 
capability  or  EF-111  jamming  support  was  available  for 
survivability  testing.  (Onboard  ECM  was  used  in  FOT&E(l)) 

j.  The  threat  arrays  were  the  most  realistic 
available,  but  were  limited  in  both  types  and  numbers  of 
threats . 


k.  Evaluation  of  logistics  supportability  was 
incomplete  because  development  of  most  ILS  elements  was 
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deferred  until  production.  Contractors  provided  maintenance 
for  both  pods  and  technical  orders  were  not  available. 
Consequently,  Air  Force  hands-on  maintenance  was  limited,  and 
training  requirements  could  not  be  identified. 

FOTSE(l)  of  the  LANTIRN  system  was  conducted  by  AFOTEC  from 
December  1986  through  July  1987.  The  purpose  of  the  test  was 
threefold:  first,  to  evaluate  corrections  to  deficiencies 
identified  during  the  initial  operational  test  and  evaluation 
( IOT&E)  of  the  LANTIRN  system;  second,  to  further  evaluate  and 
assess  operational  effectiveness  and  suitability  objectives 
that  were  incomplete  from  previous  testing;  and  third,  at  the 
request  of  Tactical  Air  Command  (TAC),  to  provide  an  assessment 
of  pilot  experience  and  training  levels  required  for  a  LANTIRN 
NAV  pod-equipped  F-16. 

AFOTEC  flew  63  effective  test  sorties  during  FOT&E(l)  as 
shown  below: 


Location 

#  of  Sorties 

Purpose  of  Test 

Eglin  AFB,  FL 

29 

LANTIRN  Assessment 

9 

EOCM  (Note  2) 

8 

Maverick  (Note  3) 

12 

LGB  (Note  4,  5) 

Nellis  AFB,  NV 
(Note  l) 

6 

LGB  (Note  5) 

Edwards  AFB,  CA 

12 

6 

LGB  (Note  5) 

6 

Conventional  Toss 

Edwards  AFB,  CA 

16 

TAC  Syllabus  Assessment 

Total 

63 

NOTES : 

1.  Missions  launched  and  recovered  at  Edwards  AFB . 

2.  Electro-optical  countermeasures. 

3.  Imaging  Infrared  Maverick  missile  (AGM-65D). 

4.  Laser  guided  bomb. 

5.  38%  of  total  LGB  missions  flown  with  safety  pilot 
(75%  of  live  LGB  missions  had  a  safety  pilot) 

The  critical  operational  issues  examined  in  FOT-iE(l)  were 
the  same  as  those  tested  earlier  for  IOT&E  with  the  exception 
of  LANTIRN  as  an  aid  to  navigation  and  its  impact  on 
survivability.  Previous  IOT&E  adequately  addressed  these  two 
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issues  by  determining  the  LANTIRN  NAV  pod's  capability  to  aid 
navigation  and  increase  survivability.  FOT&EO)  testing 
emphasized  evaluation  of  the  attack  capability  provided  by  the 
LANTIRN  TGT  pod. 

LANTIRN  FOT&E(l)  test  missions  were  flown  using  the  planned 
operational  mission  profiles  and  configurations  using  both 
single  and  two-seat  F-16  aircraft.  Weapon  delivery  test 
objectives  were  designed  to  evaluate  the  LGB,  Maverick,  and 
conventional  toss  capability  provided  by  LANTIRN-equipped 
F-16s.  The  test  missions  were  flown  in  the  desert  environment 
at  or  near  Edwards  AFB ,  CA.  and  in  significantly  higher 
absolute  humidity  conditions  during  a  deployment  to  Eglin  AFB, 
FL.  Some  missions  flown  during  the  Eglin  deployment  were  flown 
in  the  presence  of  target  area  defense  simulators  while  using 
active  onboard  ECM  to  maximize  test  realism.  Weapon  delivery 
test  missions  were  flown  against  target  arrays  representative 
of  the  types  of  targets  LANTIRN-equipped  aircraft  will  be 
tasked  to  attack  in  wartime.  All  effectiveness  objectives  were 
designed  to  assess,  insofar  as  the  limitation  of  the  FSD 
equipment  allowed,  the  issue  of  single-seat  effectiveness,  with 
primary  emphasis  on  TGT  pod  improvements  since  IOT&E  and  the 
impact  of  those  improvements  on  LANTIRN-equipped  F-16  attack 
capability. 

Effects  of  integration  into  the  Tactical  Air  Force  (TAF) 
mission  and  pilot  training  requirements  were  addressed  through 
an  assessment  of  a  NAV  pod  training  syllabus  provided  by  TAC. 
Two  relatively  inexperienced  pilots  from  operational  squadrons 
flew  the  syllabus,  with  instruction  provided  by  experienced 
members  of  the  LANTIRN  test  team. 

FOT&E(l)  included  completion  of  an  EOCM  susceptibility 
analysis  conducted  by  the  Office  of  the  Test  Director  (OTD), 
Electro-Optical  Guided  Weapons  Countermeasure/Counter- 
Countermeasures  Joint  Test  and  Evaluation  Directorate.  This 
analysis  was  planned  and  scheduled  for  completion  as  part  of 
the  overall  EOCM  investigation  during  LANTIRN  IOT&E,  but  was 
not  performed  in  its  entirety  due  to  scheduling  conflicts 
during  IOT&E. 

System  reliability  and  maintainability  were  evaluated 
against  TAC  requirements  using  the  same  objectives  developed 
for  IOT&E,  As  in  IOT&E,  LANTIRN  supportability  was  not  fully 
evaluated  due  to  the  lack  of  major  ILS  elements.  However, 
AFOTEC  did  assess  LANTIRN  support  planning  and  identify 
potential  supportability  problems. 
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The  major  test  limitations  to  FOT&E(l)  included: 

a.  .Differences  between  the  FSD  targeting  pods  and 
production  equipment.  The  tested  FSD  pods,  however,  were 
considered  reasonably  representative  of  the  production  pod  and 
allowed  evaluation  of  key  pod  capabilities.  (Production  TGT 
pod  was  delivered  to  flight  test  in  August  1988.) 

b.  The  tested  FSD  TGT  pods  did  not  incorporate  many 
reliability  and  maintainability  improvements  planned  for 
production  as  a  result  of  previous  testing.  (Production  TGT 
pod  incorporating  improvements  was  flown  in  August  1988.) 

c.  The  FSD  TGT  pods  were  contractor  maintained  during 
the  test  and  AFOTEC  was  limited  in  its  ability  to  fully  assess 
the  maintainability  of  the  LANTIRN  system.  Limited  hands-on 
work  by  test  team  maintenance  evaluators  was  assessed,  and  all 
contractor  actions  were  evaluated  over-the-shoulder . 

d.  The  production  Euilt-in-test  (BIT)  capability  was 
not  availatle;  therefore,  preventive  maintenance  was  performed 
using  data  from  unique  flight-test  instrumentation.  (BIT 
capability  has  shown  steady  improvement  through  successive 
software  updates  since  FOTSE(l).) 

e.  Major  ILS  elements  (support  equipment,  technical 
documentation,  and  maintenance  training)  were  not  available  for 
assessment.  Plans  for  supporting  LANTIRN  equipment  in  the 
field  were  reviewed. 

f.  Differences  between  the  testbed  F-16  aircraft 
compared  to  production  aircraft.  Lack  of  a  full-up  F-16  C/D 
Block  40  aircraft  meant  the  tested  F-16/LANTIRN  combination  did 
not  have  several  items  essential  to  a  complete  end-to-end 
evaluation  of  the  entire  pilot/aircraft/LANTIRN  system.  (F-16s 
with  Block  40  avonics  were  flown  with  a  production  LANTIRN  TGT 
pod  in  late  1988.) 

g.  Full  implementation  of  the  planned  production 
F-16C/D  Block  40  hardware  and  software  was  not  possible  because 
it  was  still  under  development  at  the  time  of  testing.  Partial 
Block  40  software  and  avionics  were  used  for  test  and  did  not 
include  software  enhancements  for  unguided  weapon  dive  delivery 
modes.  (Full  Block  40  software  and  avionics  were  flown  with 
LANTIRN  in  late  1988. ) 

h.  Planned  improvements  to  eliminate  deficiencies  in 
conventional  (unguided)  bombing  accuracy  U3ing  the  TGT  pod 
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laser  ranging  were  only  partially  developed.  (Improvements 
were  demonstrated  on  Block  40  F-16  in  late  1988.) 

i.  Global  Positioning  System  (GPS)  equipment  was  not 
available. 

j.  The  planned  F-16  Automatic  Terrain  Following  (ATF) 
system  was  not  available. 

k.  The  APG-66  radar  used  on  the  testbed  aircraft 
lacked  the  F-16C/D  APG-68  radar’s  moving  target  and  improved 
resolution  ground  map  capabilities. 

l.  Range  restrictions,  the  inability  to  fire  the 
laser  off-range,  and  other  peacetime  safety  constraints 
affected  the  operational  realism  of  the  testing.  For  example, 
range  and  safety  restrictions  required  Maverick  missile  firing 
to  be  displaced  to  a  less  than  operationally  desired  distance 
from  the  target  because  of  the  missile's  safety  footprint  and 
the  physical  boundaries  of  the  range. 

m.  Range  safety  considerations  did  not  permit  manned 
threat  simulators/emitters  to  be  used  on  a  range  where 
live/inert  ordnance  delivery  was  planned. 

The  specific  test  limitations  in  IOT&E  and  FOT&E(l)  which 
critically  affected  determination  of  the  TGT  pod’s  operational 
effectiveness  and  suitability  are  discussed  later  in  this 
report . 

After  consideration  of  the  results  of  FOT&E(l)  in  October 
1987,  the  Air  Force  decided  to  continue  low-rate  production  of 
the  TGT  pod  and  agreed  with  the  Director,  Operational  Test  and 
Evaluation,  upon  eighteen  criteria  which  had  to  be  addressed 
prior  to  making  a  full-rate  production  decision  on  the  TGT 
pod.  The  criteria  included  considerations  for  pod  reliability 
and  maintainability,  aircraft  integration,  and  weapon  delivery 
capability  using  LANTIRN.  The  1988  availability  and  flight 
test  of  production  navigation  and  targeting  pods  and  F-16  test 
aircraft  with  production  Block  40  software,  as  well  as 
production  F-15E  aircraft,  have  overcome  most  of  the  critical 
operational  effectiveness  test  limitations  listed  above.  An 
extensive  LANTIRN  flight  test  program  involving  both 
developmental  test  flights  and  test/training  missions  for  F-16 
and  F-15E  pilots  preparing  for  operational  testing  of  those 
aircraft  has  provided  additional  test  data  since  formal 
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FOT&E( l )  ended  in  July  1937.  Specifically,  this  flight  test 
program  has  included  943  sorties  and  1544  hours  on  LANTIRN 
equipment,  including  610  hours  on  the  TGT  pod,  since  July  1987. 

Limitations  to  test  which  affect  determination  of 
suitability  (contractor  maintenance,  lack  of  ILS  equipment, 
etc.)  have  not  been  overcome.  It  is  important  to  note, 
however,  that  the  Air  Force  intends  to  utilize  interim 
contractor  support  (ICS)  as  part  of  its  LANTIRN  support  concept 
in  the  field  until  it  completes  an  AFOTEC-directed  maintenance 
evaluation  (i.e.,  blue  suit  maintenance  capability)  in  1990. 

The  results  of  this  evaluation  will  be  reported  to  the  Congress 
when  it  is  completed. 

The  results  of  IOT&E,  FOTSE(l),  and  additional  flight  test 
data  obtained  since  July  1987  provide  a  great  deal  of 
information  on  which  to  base  an  effectiveness  and  suitability 
assessment  of  the  LANTIRN  system  and,  specifically,  the 
targeting  pod.  The  limitations  to  test  regarding  the  absence 
of  production  pods  and  aircraft  noted  above  in  IOT&E  and 
FOT&E( 1 )  were  of  concern  to  DOT&E  in  1987 — so  much  so  that  the 
Director  stated  to  the  Air  Force  that  the  results  of  testing  at 
that  time  warranted  increased  production  but  not  full-rate 
production  of  the  TGT  pod.  The  fact  that  most  of  the  critical 
test  limitations  have  been  overcome  in  the  past  year  of 
testing,  combined  with  previous  and  recent  successful  test 
results,  lead  to  the  conclusion  that  LANTIRN  testing  has  been 
adequate  to  support  a  full-rate  production  decision  for  the  TGT 
pod.  Ongoing  F-15E  operational  tests  and  the  beginning  of  F-16 
C/D  Block  40  operational  testing  in  the  near  future  with 
LANTIRN  will  further  add  to  the  LANTIRN  test  data  base.  The 
results  of  this  future  testing  of  the  production  aircraft  with 
LANTIRN  and  the  Air  Force  LANTIRN  maintenance  evaluation  will 
be  reported  to  the  Congress  in  the  DOT&E  Annual  Report. 
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OPERATIONAL  EFFECTIVENESS 

Operational  effectiveness  of  the  LANTIRN  system  was 
determined  through  evaluation  of  test  objectives  derived  from 
and  associated  with  the  critical  operational  issues  listed  in 
the  Test  Adequacy  section  of  this  report.  Where  applicable, 
objective  criteria  were  provided  by  the  user  throughout  all 
phases  of  test.  Criteria  were  added  or  changed  as  LANTIRN 
capabilities  became  apparent  and  matured  during  five  years  of 
testing.  The  original  requirement  for  LANTIRN  was  not 
specific,  since  the  Air  Force's  goal  at  the  beginning  of  its 
development  was  to  provide  increased  night  attack  capabilities 
using  emerging  and  improved  infrared  technology.  Operational 
effectiveness  of  the  LANTIRN  targeting  pod,  which  is  used 
primarily  for  transition  to  attack  and  attack,  was  evaluated  as 
the  capability  of  a  LANTIRN-equipped  F-16  to  deliver 
laser-guided  bombs  (LGBs ) ,  Imaging  Infrared  (HR)  Maverick 
missiles,  and  conventional  weapons  in  a  toss  delivery  mode. 
Additionally,  the  adequacy  of  LANTIRN  controls  and  displays, 
navigation  capability,  survivability,  LANTIRN  integration  into 
the  Tactical  Air  Forces  (TAF),  and  the  susceptibility  of 
LANTIRN  to  EOCM  were  assessed  during  testing. 

IOT&E  was  accomplished  in  two  separate  phases.  The  TGT  pod 
was  not  available  for  test  in  October  1984  when  the  Air  Force 
conducted  a  limited  evaluation  of  the  WFOV  HUD  and  the  NAV 
pod.  A  full  system  (with  TGT  pod)  IOT&E  was  conducted  from 
January  1986  to  April  1986  using  the  most  current  software 
available  on  F~16s  at  that  time.  NAV  pod  operational 
performance  was  satisfactory,  while  the  TGT  pod  exhibited 
deficiencies  which  needed  improvement  and  further  testing. 

FOTSE(l)  was  accomplished  using  improved  FSD  TGT  pods  and 
upgraded  F-16  aircraft  with  avionics  and  software  more  closely 
representative  of  the  F-16  Block  40  aircraft  planned  for 
deployment  with  LANTIRN.  Primary  emphasis  during  FOT&E(l)  was 
on  TGT  pod  technical  improvements  since  IOT&E,  and  the  impact 
of  those  improvements  on  LANTIRN-equipped  F-16  attack 
capability.  TGT  pod  deficiencies  identified  in  previous  IOT&E 
testing  were  FOV  size  and  performance,  inadequate  tracking 
system  tenacity,  inadequate  FLIR  recognition  range,  and 
Maverick  handoff  problems.  FOT&E(l)  evaluated  corrections  to 
all  these  deficiencies  as  well  as  improvements  to  LANTIRN 
software  and  hands-on  sensor  controls.  Subsequent  to  FOT&E(l), 
LANTIRN  testing  has  been  conducted  with  F-16  aircraft  usinc 
production  Block  40  avionics  and  software  with  a  production  TGT 
pod  and  FSD  TGT  pods  with  greater  numbers  of  production 
components . 
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All  LANTIRN  weapon  delivery  missions  with  the  FSD  targeting 
pod  in  FOTSE(l)  were  flown  using  TAC's  planned  operational 
mission  profiles  and  configurations.  The  test  sorties  were 
flown  in  the 'desert  environment  at  or  near  Edwards  AFB,  and  in 
high  absolute  humidity  conditions  during  a  two-month  deployment 
to  Eglin  AFB.  During  the  Eglin  deployment,  seven  sorties  were 
flown  in  the  presence  of  target  area  defense  simulators  to 
enhance  test  realism.  ALQ-131  electronic  countermeasures  (ECM) 
pods  were  carried  on  17  sorties.  Simulated  LGB  attack  missions 
against  real-world  targets  and  live  LGB  delivery  missions 
against  an  array  of  buildings  representative  of  targets 
LANTIRN-equipped  aircraft  will  be  tasked  to  attack  in  wartime 
were  flown.  Similar  live  and  simulated  missions  were  flown 
using  Maverick  and  conventional  weapons. 

The  F-16/LANTIRN  LGB  capability  in  FOT&EQ)  was  evaluated 
by  flying  mission  profiles  which  consisted  of  a  low-level  route 
to  an  initial  point  (IP),  followed  by  a  first-look,  simulated 
or  actual  toss/loft  attack  against  a  realistic  target.  TAC 
mission  planning  personnel  supported  all  LGB  missions  and 
assisted  in  route  planning  and  target  selection.  Due  to  the 
lack  of  an  Automatic  Terrain  Following  flight  control  system  on 
the  testbed  F-16  aircraft  and  other  safety  considerations,  some 
(38%)  of  the  total  LGB  missions  were  flown  in  a  two-seat 
aircraft  with  a  pilot  safety  observer  in  the  rear  cockpit.  The 
safety  observer  did  not  participate  in  the  navigation  or  attack 
segments  of  the  test  missions.  To  increase  test  realism,  F-16 
aircraft  carried  operable  ECM  pods  and  surface-to-air  threat 
simulators  were  used  during  actual  LGB  delivery  missions  on  the 
Eglin  AFB  ranges.  The  use  of  chaff /flares  in  the  target  area 
was  simulated  because  the  aircraft  did  not  have  a  functional 
ALE-40  system.  Pilots  did  note  simulated  use  of  chaff/flares 
on  voice  tapes  of  the  missions. 

The  test  team  based  their  evaluation  of  LGB  attack 
capability  solely  upon  first-pass  attacks  during  those  missions 
where  (1)  navigation  to  the  IP  was  successful,  and  (2)  weather, 
target /background  heat  contrast,  and  IR  visibility  conditions 
were  within  the  demonstrated  operating  envelope  of  the  LANTIRN 
system.  The  operational  test  pilots  judged  the  usability  of 
LANTIRN  for  F-16  LGB  delivery  capability  and  measured  the 
percentage  of  correctly  identified  targets,  successful  lock-on 
attempts,  successful  target  tracks,  successful  laser 
designations,  and  successful  attacks. 

The  operational  test  team  pilots  qualitatively  evaluated 
LANTIRN' s  usability  for  single-seat  LGB  delivery  as 


UNCLASSIFIED 


VI 1-71 


marginally  acceptable.  Pilot  workload  was  normally  very  high 
during  the  LGB  delivery  phase,  and  was  unacceptably  high  on 
those  missions  where  unfavorable  target  characteristics  were 
combined  with  low  IR  visibility  and/or  post-release  tracker 
slewing  problems.  The  pilots  considered  that  a  correction  to 
the  tracker  slewing  problem  was  mandatory,  and,  even  with  this 
correction,  safe,  reliable,  effective  F-16  LGB  employment  will 
require  highly  qualified  pilots  and  careful  target  selection. 

A  fix  to  the  tracker  slewing  problem  was  evaluated  by  AFOTEC 
pilots  in  October  1988  and  considered  satisfactory. 

Improvements  to  the  identified  deficiency  in  FLIR  target 
recognition  range  were  demonstrated  with  a  44%  better 
recognition  range  in  narrow  FOV  than  that  previously  achieved 
in  IOT&E.  The  FOTSE(l)  observed  TGT  pod  range  performance  was 
much  better  than  required  for  the  planned  wartime  weapon 
delivery  profiles  used  during  test. 

The  thrust  available  from  the  F-16A/B  test  aircraft  used  in 
FOT&E(l)  for  some  LGB  toss/loft  deliveries  raised  operational 
problems.  Production  F-16  C/D  Block  40  aircraft  will  be 
powered  by  either  the  F-110-GE-100  engine  or  the  F-100-PW-220 
engine,  which  are  expected  to  provide  an  increase  in  thrust. 

LGB  conclusions  from  FOT&E(l)  were  that  the  testbed 
LANTIRN-equipped  F-l6s  demonstrated  a  limited  LGB  attack 
capability.  High  pilot  workload  during  critical  phases  of  the 
attack,  unpredictable  TGT  pod  tracker  performance,  and 
post-release  tracker  slewing  problems  made  LGB  attacks 
difficult.  However,  system  performance  was  significantly 
improved  under  favorable  IR  visibility  conditions  against 
thermally  significant  targets  with  low  background  clutter. 

The  slew  problem  has  been  solved  and  the  tracker  has  shown 
improved  performance  in  1988. 

Maverick  missile/LANTIRN  capability  was  primarily  evaluated 
by  flying  mission  profiles  which  consisted  of  a  low-level  route 
to  an  IP  and  a  single-pass,  live  or  simulated  attack  against  a 
stationary  array  of  M-47  tanks  on  the  Eglin  AFB  range  complex. 
Both  single  and  dual  Maverick  launches  were  evaluated.  The 
test  team  evaluated  only  first-look  attacks  where  navigation  to 
the  target  area  was  successful  and  where  IR  visibility  and 
target  temperature  differences  were  within  the  LANTIRN  system 
operating  envelope. 

The  LANTIRN  system  was  well  integrated  with  the  testbed 
F--16C/D  avionics  and  with  the  HR  Maverick.  Improvements  in 
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the  missile  boresight  correlation  process  increased  the  pilots' 
ability  to  monitor  the  Maverick,  video  and  assisted  his 
situation  awareness.  Hands-on  control  mechanization  made  it 
possible  for'the  pilot  to  take  control  of  the  missile  and  lock 
on  manually  if  necessary.  Handoffs  from  the  TGT  pod  to  live 
AGM-65D  Mavericks  were  very  rapid.  F--16  test  team  pilots 
qualitatively  evaluated  LANTIRN/Maverick  usability  by  measuring 
the  percentage  of  successful  simulated  or  actual  Maverick 
single  and  two-shot  attacks  using  the  TGT  pod. 

Despite  the  high  absolute  humidity  conditions  which  caused 
very  poor  IR  visibility  conditions  in  the  Eglin  AFB 
environment,  target  recognition  ranges  and  Maverick  handoff  and 
lock-on  performance  were  satisfactory.  In  these  conditions, 
the  TGT  pod  improved  target  detection  ranges  over  those  which 
would  have  been  possible  with  the  unassisted  IIR  Maverick.  In 
addition,  the  F-16/TGT  pod  lock-on  and  missile  handoff 
mechanization  allowed  two-shot  deliveries  with  minimum  tracking 
time.  The  system  provided  an  effective  single  and  dual  launch 
capability  against  armored  vehicles. 

Maverick  conclusions  were  that  the  testbed  LANT I RN- equipped 
F-16s  demonstrated  a  much-improved  IIR  Maverick  delivery 
capability  over  that  of  aircraft  without  the  TGT  pod. 

Conventional  unguided  toss  capability  using  LANTIRN  on  the 
F-16  was  evaluated  using  the  same  sorties  as  for  the  LGB 
evaluation.  The  criteria  were  less  stringent,  because  LANTIRN 
TGT  pod  tracking  and  laser  designation  were  not  required  after 
weapon  release  for  this  evaluation.  In  addition,  the  test  team 
flew  controlled  sorties  over  Edwards  AFB  ranges  to  determine 
the  impact  the  TGT  pod  had  on  tossed-weapon  delivery  accuracy. 

Team  pilots  made  qualitative  evaluations  of  LANTIRN' s 
usability  for  F-16  unguided  toss  weapons  delivery  while  the 
percentage  of  targets  correctly  identified,  successful  lock-on 
attempts,  successful  target  tracks,  miss  distances,  and  target 
recognition  ranges  were  measured. 

Conventional  weapon  unguided  toss  capability  conclusions 
were  that  the  TGT  pod  provided  an  additional  sensor  which 
increased  the  F-16  toss  attack  capability  against 
IR-signif icant  targets.  However,  the  TGT  pod  did  not  provide 
an  increase  in  toss-bombing  accuracy  over  radar  direct-aim 
bombing  because  of  an  unresolved  toss-bombing  algorithm 
problem.  (This  aircraft-related  problem  was  resolved  in  1988.) 
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LANTIRN  controls  and  displays  were  qualitatively  evaluated 
by  mission  pilots  as  to  adequacy  and  effectiveness  and  ease  of 
use  and  effectiveness  of  LANTIRN  operator-machine  interface 
software. 

Control  and  display  conclusions  were  that  the  tested 
aircraft  hardware  and  software  incorporated  a  large  number  of 
features  planned  for  the  production  Block  40  F-16,  and  were 
significantly  improved  over  previously  evaluated  versions  that 
had  been  unsatisfactory  in  IOT&E.  Control  and  display  problems 
were  found  in  the  TGT  pod  WFOV  and  tracker  slew  control 
mechanization.  (These  problems  were  resolved  in  1988.)  The 
pilots  judged  the  adequacy  and  effectiveness  of  the 
controls/displays  and  the  operator-machine  interface  software 
to  be  acceptable  and  no  absent  or  improperly  displayed  symbols 
were  found. 

Navigation  capability  of  a  LANTIRN-equipped  F-16  was 
assessed  by  determining  pilot  ability  to  navigate  successfully 
to  an  IP  on  course,  with  accurate  steering  into  a  target  area, 
using  only  the  testbed  F-16/LANTIRN  system.  This  objective  was 
primarily  concerned  with  navigation  accuracy  at  the  IP,  which 
directly  affected  the  pilot's  ability  to  successfully 
transition  to  an  attack.  The  percentage  of  missions  in  which 
the  IP  appeared  in  the  HUD  or  TGT  pod  FOV,  successful 
identification  of  the  IP  was  made,  and  successful  inertial 
navigation  system  updates  were  accomplished  were  measured. 

Navigation  conclusions  were  that  pilots  were  able  to 
successfully  transition  to  attack  95  percent  of  the  time.  With 
the  testbed  F-16/LANTIRN  system,  successful  navigation  and 
transition  to  attack  required  a  high  level  of  pilot 
training/proficiency  and  mission  planning  support.  As  seen  in 
previous  testing,  turn-point  selection,  extremely  accurate 
turn-point  and  target  coordinates,  and  the  rate  of  INS  drift 
continued  to  be  important  factors  bearing  on  navigation  success. 

The  integration  of  LANTIRN  into  the  TAF  was  assessed  using 
TAG'S  proposed  F-16  NAV  pod  pilot-training  syllabus  and  by 
determining  additional  impacts  that  LANTIRN  will  have  on 
individual  pilots  and  LANTIRN  units.  The  TfiT  pod  syllabus  had 
not  been  developed  in  time  for  assessment  in  FOTSE(l). 

Two  young,  qualified  and  current  F-16C  pilots  from 
operational  units  completed  the  NAV  pod  syllabus  as  students. 

The  proposed  Tactical  Air  Command  syllabus  for  the  NAV  pod 
pilot  training  on  the  F-16  was  found  to  be  adequate.  The  test 
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team  recommended  that  greater  emphasis  be  placed  on 
single-ship/flight-lead  skills  during  F-16C  training  prior  to 
LANTIRN  upgrade.  Increased  mission  planning,  intelligence,  and 
weather  forecasting  support  will  be  required  for  LANTIRN 
mission  employment. 

EOCM  susceptibility  of  the  LANTIRN  system  was  determined  in 
flight  testing  which  completed  EOCM  and  susceptibility  testing 
begun  in  previous  DT&E/IOT&E. 

The  Office  of  the  Test  Director,  Electro-Optical  Guided 
Weapons,  Countermeasure/Counter-Countermeasures  Joint  Test  and 
Evaluation  Directorate  designed  and  executed  an  EOCM 
susceptibility  test  of  the  LANTIRN  system  with  AFOTEC  support. 
Night  and  day  sorties  employing  operationally  representative, 
simulated  LGB  and  Maverick  delivery  profiles  were  flown  to 
determine  LANTIRN' s  susceptibility  to  various  EOCM  devices. 

The  test  was  conducted  under  controlled  conditions  in  a 
DT&E-like  environment.  The  purpose  of  the  EOCM  testing  was: 

(1)  to  determine  the  capabilities  and  limitations  of 
the  LANTIRN  system  in  an  EOCM  environment, 

(2)  assess  the  effect  of  EOCM  on  operational 
performance  of  the  LANTIRN  system,  and 

(3)  provide  information  to  the  developer  and  the  TAF 
concerning  possible  counter-countermeasures 
improvements  and  tactics. 

The  effects  of  fog  oil  smoke,  IR  absorbing  aerosols,  white 
phosphorous  flares,  high- intensity  thermal  source  (HITS) 
pyrotechnics,  pulsed  and  continuous-wave  lasers,  105  mm  tank 
rounds,  and  flamethrowers  on  the  LANTIRN  NAV  and  TGT  pods  were 
investigated  for  each  countermeasure  effect  on  target 
acquisition  and  tracker  performance. 

During  acquisition  denial  testing,  the  LANTIRN  system  was 
flown  into  a  target  area  in  which  an  EOCM  was  already 
initiated,  or  initiated  during  the  target  acquisition  (target 
identification  and  lock-on)  phase  of  the  attack.  During 
tracker  interference  testing,  the  pilot  was  allowed  to  acquire 
and  establish  track  of  the  target  before  the  EOCM  was  initiated. 

EOCM  susceptibility  conclusions  were  that  the  LANTIRN 
system  was  susceptible  to  the  EOCM  used  in  this  test  to  varying 
degrees  according  to  the  countermeasure  (CM)  used.  The  NAV  pod 
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and  TGT  pod  FLIRs  were  affected  in  the  same  manner,  however, 
the  CM  effects  on  the  NAV  pod  FLIR  were  minimal,  did  not  deny 
target  area  acquisition,  and  were  insufficient  to  preclude 
using  the  NAV  pod.  The  TGT  pod  was  more  vulnerable  to  EOCM, 
but  usually  only  if  the  CMs  were  within  or  slightly  outside  its 
FOV.  The  LANT1RN  system  demonstrated  significant  resistance  to 
the  EOCM  tested.  Although  system  performance  was  degraded  and 
pilot  workload  was  increased  because  of  the  CMs,  the  LANTIRN 
system  attack  capability  was  not  totally  denied. 

Test  limitations  in  the  testbed  aircraft  during  FOT&E(l) 
which  critically  effected  evaluation  of  the  LANTIRN  targeting 
pod's  operational  effectiveness  included: 

a.  A  full  implementation  of  the  planned 
production  F-16C/D  block  40  hardware  and  software  with  LANTIRN 
was  not  possible  because  a  full-up  Block  40  F-16  was  not 
available.  Lack  of  new  F-16  software  enhancements  to  unguided 
weapon  dive  delivery  modes  did  not  allow  new  data  on  those 
delivery  methods  to  be  gathered  during  FOT&E(l).  This 
limitation  precluded  evaluation  of  the  primary  F-16 
conventional  weapon  delivery  modes  using  LANTIRN  with  a  variety 
of  common  munitions.  Most  important,  it  precluded 
demonstration  of  the  functionality  of  the  TGT  pod  with  the 
production  aircraft  avionics.  (This  major  limitation  was 
overcome  when  an  F-16  aircraft  with  production  Block  40 
avionics  became  available  and  was  tested  with  a  production 
LANTIRN  TGT  pod  in  late  1988.) 

b.  Planned  improvements  to  eliminate 
deficiencies  in  conventional  (unguided)  bombing  accuracy  using 
TGT  pod  laser  ranging  were  only  partially  developed.  This 
limitation  precluded  determination  of  the  weapon  accuracies 
available  with  an  integrated  F-16/LANTIRN  system.  (Recent  tests 
have  demonstrated  a  satisfactory  solution  to  this  problem. ) 

c.  The  planned  Global  Positioning  System 

(GPS)  equipment  (or  GPS  level  of  navigation  accuracy)  was  not 
available.  This  limitation  caused  increased  pilot  workload 
during  low  level  navigation  and  transition  to  attack.  (GPS 
entered  developmental  testing  on  the  F-16  in  1988.) 

d.  The  Automatic  Terrain  Following  (ATF) system 
planned  for  the  F-16  was  not  available.  This  limitation 
increased  pilot  workload.  (F-16  ATF  developmental  test  is 
on-going. ) 
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e.  The  FOT&E(l)  testbed  F-16  aircraft  used  an  APG-66 
radar.  This  radar  does  not  have  the  moving  target  track  and 
improved  ground  map  resolution  capabilities  which  will  be 
available  with  the  F-16  Block  40  APG-68  radar.  (F-16  aircraft 
with  APG-68  radar  were  flown  with  LANTIRN  in  1988.) 

Additionally,  operational  realism  in  LANTIRN  testing  was 
constrained  by  range  restrictions,  inability  to  fire  the  laser 
off-range,  and  other  peacetime  safety  constraints.  For 
example,  range  and  safety  restrictions  required  HR  Maverick 
firings  to  he  displaced  to  less  than  operationally  desired 
distances  from  the  target  because  of  the  missile's  safety 
footprint  and  the  physical  boundaries  of  the  range  airspace. 
Range  safety  considerations  did  not  permit  manned  threat 
simulators/emitters  to  be  used  on  a  range  where  live/inert 
ordnance  delivery  was  planned.  Restricting  laser  firings  to 
test  ranges  also  precludes  its  use  for  inertial  updates  during 
low  level  navigation,  while  FAA  restrictions  on  night  low  level 
routes  limit  the  airspace,  altitude,  and  airspeeds  otherwise 
available  in  an  "operational"  environment. 

As  stated  above,  many  of  the  noted  limitations  to  test  have 
been  overcome  in  the  past  18  months  of  LANTIRN  testing  since 
formal  operational  testing  of  LANTIRN  ended  in  July  1987.  Most 
important  is  the  testing  of  a  production  TGT  pod  on  an  F-16 
using  production  Block  40  software  and  avionics.  Additionally, 
LANTIRN  has  demonstrated  functional  integration  on  the 
production  F-15E  with  production  TGT  and  NAV  pods.  The  results 
of  this  testing  have  shown  the  functional  integration  of 
LANTIRN  using  production  equipment,  as  well  as  performance 
improvements  in  TGT  pod  tracker  tenacity,  tracker  slew  control, 
and  integrated  weapon  delivery.  Based  on  the  results  of 
LANTIRN  testing  since  FOTE>E(l),  DOT&E  assesses  F-16  LGB 
delivery  capability  to  be  better  than  the  marginal  rating 
assigned  after  FOT&E(l)  and  satisfactory  against  a  limited 
target  set.  LANTIRN/Maverick  delivery  capability  is  considered 
satisfactory,  as  is  limited  conventional  weapon  delivery 
capability  using  the  LANTIRN  pods  to  deliver  MK-82  bombs.  Much 
testing  of  the  LANTIKN/F-1 6  weapon  system  remains  to  be  done 
after  delivery  of  the  production  aircraft  and  completion  of 
F-16  Seek  Eagle  tasting  with  the  entire  range  of  conventional 
weapons.  Dedicated  operational  testing  of  LANTIRN  on  the  F-16 
Block  40  aircraft  will  be  done  in  F-16  Block  40  IOT&E  beginning 
in  1989.  This  test  phase  will  demonstrate  further  the 
functional  integration  of  the  production  LANTIRN  equipment  and 
expand  the  limited  LANTIRN/F-16  conventional  weapon  delivery 
testing  to  include  operational  profiles  and  more  types  of 
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weapons.  A  similar  IOT&E  for  the  F-15E/LANTIRN  has  begun  and 
will  be  completed  in  1989.  LANTIRN  controls  and  displays  on 
the  F-16  and , navigation  capability  are  satisfactory.  LANTIRN 
NAV  pod  integration  into  the  tactical  air  forces  is  assessed 
as  satisfactory  for  F-16  pilot  workload  in  navigation  and 
terrain  following.  LANTIRN  TGT  pod  integration  has  not  been 
adequately  addressed  due  to  podyaircraft  limitations 
mentioned.  The  complete  LANTIRN  system  will  require  high 
levels  of  F-16  pilot  proficiency  and  training.  F-15E 
integration  will  be  easier  due  to  a  two-man  crew.  LANTIRN- 
equipped  fighter  squadrons  will  require  increased  support  in 
weather  and  intelligence. 
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OPERATIONAL  SUITABILITY 

FOT&E( l )  rated  the  operational  suitability  of  the  entire 
LANTIRN  system  (all  three  components).  Specific  ratings  were 
provided  for  individual  components  where  the  data  were 
available.  Four  aspects  of  operational  suitability,  which 
included  logistics  reliability,  mission  reliability,  system 
maintainability,  and  system  availability,  were  evaluated  and 
potential  supportability  problems  were  identified.  The  data 
base  which  reports  current  results  and  projects  estimates  for 
future  reliability,  maintainability  and  availability,  is 
cumulative  and  updated  constantly  with  results  of  all  LANTIRN 
experience  in  both  developmental  and  operational  test 
missions.  This  report  reflects  results  for  FOT&E(l),  which 
ended  in  July  1987,  and  the  cumulative  current  projections 
which  include  data  from  1897  hours  of  LANTIRN  operating  time 
and  1557  hours  of  LANTIRN  flight  time  since  July  1987. 

Logistics  reliability  is  measured  using  mean  time  between 
maintenance  for  inherent  failures  ( MTBMI ) .  MTBMI  is  the 
average  number  of  operating  hours  (OH)  between  inherent, 
on-equipment  maintenance  actions.  At  the  time  of  FOT&E(l), 
reliability  data  were  collected  throughout  the  DT&E,  IOT&E  and 
FOT&E  tests.  MTBMI  was  projected  to  maturity  (10,000  operating 
hours)  using  techniques  from  Military  Handbook  (MIL-HDBK)  189, 
Reliability  Growth  Management.  A  range  of  values  (optimistic 
and  conservative)  was  projected.  The  lower  bound  (conservative 
projection  assumed  the  reliability  growth  demonstrated  in  test 
continued  to  maturity.  The  upper  bound  (optimistic)  projection 
used  the  same  growth  rate,  but  also  included  an  assessment  of 
the  impact  of  pending  system  improvements,  which  should  provide 
additional  reliability  enhancements.  F0T&E(1)  test  results, 
FOT&E(l)  mature  MTBMI  projections,  and  mature  evaluation 
criteria  are  shown  below.  In  addition,  a  current  (as  of 
December  1988)  mature  projection  is  shown  which  reflects  the 
equipment  improvements  demonstrated  in  flight  test  since  July 
1987. 


Logistics  Reliability  Criteria  and  Results 
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F0T&E(1)  conclusions  were  that  the  logistics  reliability  of 
the  LANTIRN  system  was  projected  to  meet  the  user's 
requirements  at  maturity,  primarily  due  to  the  high  reliability 
of  the  WFOV  HUD  and  Nav  Pod.  At  that  time,  the  logistics 
reliability  of  the  TGT  pod  was  rated  marginal  because  of  the 
high  failure  rate  of  the  central  electronics  unit  (CEU)  and 
components  within  the  nose/roll  section.  The  specific 
nose/roll  section  components  which  failed  several  times  were 
the  slip  rings,  cooler/detector,  and  laser  transmitter/ 
receiver.  Since  July  1987,  these  TGT  pod  components  have  been 
redesigned.  Flight  test  results  have  demonstrated  significant 
improvement  which  is  reflected  in  the  current  mature  projection 
above . 

System  reliability  of  the  LANTIRN  system  (and  targeting 
pod)  as  it  affects  mission  performance  was  measured  using 
weapon  system  reliability  (WSR).  WSR  is  the  probability  that 
the  system  or  subsystem  can  complete  a  mission  without  a 
critical  failure.  Mean  time  between  critical  failure  (MTBCF) 
was  the  parameter  used  for  the  calculation  of  WSR.  Appropriate 
hardware  failures  were  classified  as  critical,  and  a  range  of 
expected  MTBCF  was  projected  to  maturity  (10,000  hours)  using 
the  method  and  techniques  described  for  logistics  reliability. 
These  projections  were  used  to  calculate  a  mature  WSR.  Because 
of  Known  and  previously  reported  deficiencies  in  FSD  fault 
reporting  software,  many  erroneous  BIT  failure  indications 
which  could  have  resulted  in  needless  mission  aborts  were  not 
included  in  the  WSR  calculations  in  FOT&E .  If  they  had  been, 
reliability  would  have  been  lower.  LANTIRN  system 
fault-reporting  software  was  and  is  being  redesigned  for 
production  to  eliminate  erroneous  fault  indications.  FOTSE(l) 
test  results,  mature  evaluation  criteria,  and  FOT&E(l)  mature 
WSR  projections  are  shown  below.  In  addition,  a  current  (as  of 
December  88)  mature  projection  is  shown  which  reflects 
equipment  improvements  demonstrated  in  flight  test  since  July 
1987. 


Mission  Reliability  Criteria  and  Results 
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FOT&E( 1 >  conclusions  were  that  the  LANTIRN  system  mission 
reliability  was  projected  to  meet  the  user's  requirements  at 
maturity,  primarily  because  of  NAV  pod  and  WFOV  HUD 
reliability.  The  TGT  pod  reliability  was  rated  marginal  (one 
percent  short  of  the  requirement  in  the  optimistic 
projection).  Current  projection  is  that  the  TGT  pod  will  meet 
the  requirement. 

Maintainability  of  the  LANTIRN  system  (not  the  targeting 
pod)  in  FOTScE(l)  was  estimated  by  observing 

contractor-performed  maintenance  and  then  estimating  component 
removal  and  replacement  times  for  a  representative  USAF  field 
environment.  These  estimated  "blue  suit"  values  were  used  to 
compute  maintenance  man-hour  per  operating  hour  (MMH/OH) 
Because  the  computations  included  spares  and  manpower  planned 
for  the  maintenance  of  all  LANTIRN  components,  only  an  overall 
system  MMH/OH  was  reported.  Test  results,  mature  evaluation 
criteria,  and  mature  MMH/OH  estimates  are  shown  below: 


LANTIRN  System  Maintainability  Criteria  and  Results 
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FOT&Ed)  MMH/OH  met  the  requirement  in  FOT&Ed).  Mean  down 
time  (as  calculated  in  a  computer  simulation  model)  did  not 
satisfy  the  criterion  in  FOT&Ed).  As  during  IOT&E,  the 
FOT&Ed)  test  team  qualitatively  rated  the  FSD  TGT  pod  ease  of 
maintenance  as  inadequate.  In  addition,  BIT  mechanization  in 
the  FSD  LANTIRN  equipment  was  not  capable  of  supporting  fault 
isolation  and  troubleshooting.  The  BIT  mechanization  and  the 
TGT  pod  center  section  were  redesigned  and  have  been  flight 
tested  on  a  production  TGT  pod. 


Availability  of  the  LANTIRN  system  (not  individual 
components)  was  measured  using  many  of  the  same  estimated 
values  discussed  above  to  determine  a  fully  mission  capable 
(FMC)  rate.  LANTIRN  system  availability  was  projected  using 
computer  estimates  of  "blue  suit"  maintenance  capabilities  to 
meet  the  user's  requirement  of  80%  FMC  at  maturity  (10,000 
hours)  within  a  range  of  87%  to  92%. 
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Logistics  supportability  could  not  be  tested  as  no 
integrated  logistics  support  (ILS)  elements  were  available  for 
testing. 

Limitations  to  test  which  critically  affected  the  conduct 
and  results  of  FOT&E(l)  with  regard  to  operational  suitability 
included: 


a.  The  tested  LANTIRN  NAV  and  TGT  full  scale 
development  pods  did  not  incorporate  many  reliability  and 
maintainability  improvements  planned  for  production  as  a  result 
of  previous  testing.  This  limitation  precluded  assessment  of 
planned  design  changes  and  their  subsequent  affect  on  RAM. 
(Production  NAV  and  TGT  pods  were  flown  in  1988.) 

b.  The  FSD  pods  were  contractor-maintained  during  the 
test,  and,  therefore,  AFOTEC  was  limited  in  its  ability  to 
fully  assess  the  maintainability  of  the  LANTIRN  system. 

However,  limited  hands-on-work  by  test  team  maintenance 
evaluators  was  assessed,  and  all  contractor  actions  were 
evaluated  over-the-shoulder .  This  limitation  caused  the  Air 
Force  to  estimate  LANTIRN  blue  suit  capability  after  observing 
contractor  maintenance  actions. 

c.  The  production  built-in  test  (BIT)  capability  was 
not  available;  therefore,  preventive  maintenance  was  performed 
using  data  from  unique  flight-test  instrumentation.  (BIT 
capability  has  shown  steady  improvement  since  FOT&E(l).) 

d.  Major  ILS  elements  (support  equipment,  technical 
documentation,  and  maintenance  training)  were  not  available  for 
AFOTEC  to  assess.  As  a  result,  AFOTEC  reviewed  the  plans  for 
supporting  the  equipment  in  the  field.  This  limitation  caused 
the  Air  Force  to  estimate  LANTIRN  blue  suit  capability  after 
observing  contractor  maintenance  action. 

Since  the  conclusion  of  FOT&E(l)  in  July  1987,  an  intensive 
LANTIRN  flight  test  program  has  demonstrated  the  improved 
design  of  key  TGT  pod  components  on  both  FSD  pods  and  a 
production  pod.  The  data  derived  from  flight  test  shows 
significant  improvement  has  been  made  since  FOTSE(l).  Current 
mature  projections  for  reliability,  availability,  and 
maintainability  are  that  the  mature  criteria  will  be  achieved. 

(U)  In  addition,  progress  has  continued  on  plans  for  the 
Air  Force  to  assume  full  responsibility  for  LANTIRN 
maintenance.  In  1989,  TAC  will  participate  in  a  supportability 
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evaluation  using  both  production  navigation  and  targeting  pods, 
which  will  be  monitored  by  AFOTEC.  In  1990,  a  maintainability 
demonstration  will  be  conducted  on  one  set  of  LANTIRN 
production  pods  and  production  LANTIRN  Intermediate  Automatic 
Test  Set  (LIATS)  equipment  selected  by  the  Air  Force.  The 
LANTIRN  pods  will  be  selected  from  units  delivered  in  CY90  and 
the  intermediate  support  equipment  assets  will  be  selected  from 
serial  numbers  eight  through  thirteen.  During  the 
demonstration  the  LIATS  will  be  operated  a  minimum  of  540  hours 
and  the  contractor  will  determine  the  instantaneous  MTBF  for 
the  LIATS  equipment.  The  contractor  will  document  procedures 
for  collecting  and  evaluating  reliability  data.  Air  Force 
technicians,  trained  under  Type  I  training,  will  conduct  the 
demonstration,  assisted  by  contractors  responsible  for 
inserting  equipment  faults  and  developing  corrective  procedures 
for  any  mistakes  observed. 

Development  of  production  support  equipment  is  on  track  and 
continuous  support  equipment  validation  will  ensure  that  this 
equipment  meets  specifications.  In  November  and  December  1987, 
a  demonstration  of  the  Targeting  Pod  Support  Equipment,  using 
an  FSD  pod,  was  conducted  at  the  contractor's  facility.  TAC 
and  AFOTEC  maintenance  personnel  participated  in  the 
demonstration  which  successfully  isolated  ten  out  of  ten 
inserted  faults  (contractual  requirement  is  eight  out  of  ten). 

Because  of  the  successful  progress  on  all  suitability 
issues  of  concern  to  DOT&E  in  November  1987,  this  office  now 
considers  the  LANTIRN  TGT  pod  as  being  able  to  meet  suitability 
criteria  at  maturity  using  Air  Force  maintenance.  DOT&E 
assessments  of  future  LANTIRN  suitability  progress  and  results 
will  be  made  available  to  the  Congress  in  the  DOT&E  Annual 
Report  sections  on  on  F-15E/LANTIRN  IOT&E,  F-16C/D/LANTIRN 
IOT&E,  LANTIRN  Supportability  Evaluation,  and  LANTIRN 
maintainability  demonstration. 
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A 

ECCM 

ADATS 

Air  Defense  Anti-Tank 

ECP 

System 

ECM 

AEWTS 

Advanced  Electronic  Warfare 
Test  Set 

EDM 

EOA 

AFB 

AFEWES 

AFOTEC 

Air  Force  Base 

Air  Force  Electronic 

Warfare  Evaluation  Simulator 

EOCM 

EUT&E 

Air  Force  Operational  Test 
and  Evaluation  Center 

AGM 

EW 

Air-to-Ground  Missile 

AIM 

Air  Intercept  Missile 

EXCOM 

A$D 

Assistant  Secretary  of 

Defense 

ATF 

Advanced  Tactical 

Fighter 

F 

F/A 

B 

FDT&E 

BES 

Budget  Estimate 

Submission 

FOE 

FOT&E 

BIT 

Built-In-Test 

FWE 

B-LRIP 

Beyond  Low-Rate  Initial 

Production  Report 

FY 

c 

FYDP 

COI 

COMOPTEVFOR 

Critical  Operational  Issues 
Commander  Operational 

G 

G*0 

Test  and  Evaluation  Force 

CW 

(Navy) 

Chemical  Warfare 

I 

CY 

Calendar  Year 

ICBM 

o» 

Command,  Control, 

Communications 

IOC 

D 

IOT&E 

IPT 

DAB 

Defense  Acquisition  Board 

IR 

DDDR&E(T&E) 

Deputy  Director,  Defense 
Research  and  Engineering 

ITEA 

DoD 

(Test  and  Evaluation) 
Department  of  Defense 

J 

DoDl 

Department  of  Defense 
Instruction 

JCHEM 

DOT&E 

Director,  Operational  Test 

JCS 

and  Evaluation 

JOG 

DRB 

Defense  Resources  Board 

JTF 

DT 

Development  Test 

JTFPMO 

DT&E 

Developmental  Test  and 
Evaluation 

L 

Electronic  Counter- 
Countermeasures 
Engineering  Change  Proposal 
Electronic  CounterMeasures 
Engineering  Development 
Models 

Early  Operational  Assessment 
Electro-Optical  Counter¬ 
measures 

Early  User  Test  and  Experi¬ 
mentation 
Electronic  Warfare 
Executive  Committee  on  Air 
Defense  Threat  Simulators 


Fighter/Attack 

Force  Development  Test  and 
Experimentation 
Follow-on  Evaluation 
Follow-on  Operational  Test 
and  Evaluation 
Foreign  Weapons  Evaluation 
Program 
Fiscal  Year 

Five  Year  Defense  Plan 


General  Accounting  Office 


Intercontinental  Ballistic 
Missile 

Initial  Operational  Capability 
Initial  Operational  Test 
and  Evaluation 
Initial  Production  Test 
Infrared 

International  Test  and 
Evaluation  Association 


Joint  Chemical  Warfare 
Joint  Chiefs  of  Staff 
Joint  Oversight  Group 
Joint  Test  Force 
Joint  Tactical  Fusion 
Program  Management  Office 


LOI  Letter  of  Instruction 

LOT  Limited  Operational  Test 


G-l 


GLOSSARY 


LRIP  Low-Rate  Initial  Production  P 


M 


PDM 


MAISRC 

MCOTEA 

MEF 

MOT 

MOTF 

MOU 

MRTFB 

MS 

N 


Major  Automated  Informa¬ 
tion  System  Review  Council 
Marine  Corps  Operational 
Test  and  Evaluation  Activity 
Mission  Effectiveness  Factor 
Maturity  Operational  Test 
Mobile  Operational  Test 
Force 

Memorandum  of 
Understanding 
Major  Range  and  Test 
Facility  Base 
Missile  Seeker  Radar 


PE 

PMO 

POM 

P3I 

R 

RAM 

RDT&E 

ROC 


NATO 

NBC 

NDI 

NTCB 


North  Atlantic  Treaty 
Organization 
Nuclear,  Bilogical,  and 
Chemical 

Non-Developmental  Item 
National  Test  Capability  Base 


S 

SAC 

SAR 

SOF 

SSTC 


o 


T 


Program  Decision 
Memorandum 
Program  Element 
Program  Management 
Office 

Program  Objective 
Memorandum 
Pre-Planned  Product 
Improvement 


Reliability,  Availability,  and 
Maintainability 
Research,  Development 
Test  and  Evaluation 
Required  Operational 
Capability 


Strategic  Air  Command 
Selected  Acquisition  Report 
Special  Operations  Forces 
Space  Systems  Test 
Capability 


OA 

OPEVAL 

OSD 

OT 

OTA 

OT&E 

OT&E  CIP 


OTEA 

OTO 

OUE 


Operational  Assessment 
Operational  Evaluation 
Office  of  the  Secretary  of 
Defense 

Operational  Test 
Operational  Test  Agency 
Operational  Test  and 
Evaluation 

Operational  Test  and 
Evaluation  Capability 
Improvement  Program 
Operational  Test  and 
Evaluation  Agency  (Army) 
Operational  Test  Organi¬ 
zation  (SDS) 

Operational  Utility 
Evaluation 


T&E 

TDP 

TEC 

TEMI 


TEMP 


U 

UHF 

y 

VHF 


Test  and  Evaluation 
Test  Design  Plan 
Test  and  Evaluation 
Committee 

Test  and  Evaluation  Manage¬ 
ment  and  Investment 
Initiative 

Test  and  Evaluation  Master 
Plan 


Ultra-High  Frequency 


Very-High  Frequency 
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